Denys Shapovalov
Member since 2022
Member since 2022
在本課程中,您會學到 Google Cloud 上的資料工程、資料工程師的角色與職責,以及這些內容如何對應至 Google Cloud 提供的服務。您也將瞭解處理資料工程難題的許多方法。
This course introduces the Google Cloud big data and machine learning products and services that support the data-to-AI lifecycle. It explores the processes, challenges, and benefits of building a big data pipeline and machine learning models with Vertex AI on Google Cloud.
In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.
完成「使用 Knowledge Catalog 建構資料網格」技能徽章入門課程,即可證明您具備下列技能:使用 Knowledge Catalog 建構資料網格, 以利在 Google Cloud 維護資料安全性,並協助治理和探索資料。您將練習並測試自己的技能,包括在 Knowledge Catalog 為資產加上標記、指派 IAM 角色,以及評估資料品質。
While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.
完成「實現事件驅動的即時訊息與自動化工作流」任務,即可獲得 技能徽章。 技能徽章課程,您將瞭解如何透過 Cloud 控制台使用 Pub/Sub、 如何使用 Cloud Scheduler 工作節省心力,並透過 Pub/Sub Lite 節省擷取大量事件 的費用。