Nguyen Minh Nhat
Member since 2022
Member since 2022
這個入門微學習課程主要說明生成式 AI 的定義和使用方式,以及此 AI 與傳統機器學習方法的差異。本課程也會介紹各項 Google 工具,協助您開發自己的生成式 AI 應用程式。
In the last installment of the Dataflow course series, we will introduce the components of the Dataflow operational model. We will examine tools and techniques for troubleshooting and optimizing pipeline performance. We will then review testing, deployment, and reliability best practices for Dataflow pipelines. We will conclude with a review of Templates, which makes it easy to scale Dataflow pipelines to organizations with hundreds of users. These lessons will help ensure that your data platform is stable and resilient to unanticipated circumstances.
In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks.
Incorporating machine learning into data pipelines increases the ability to extract insights from data. This course covers ways machine learning can be included in data pipelines on Google Cloud. For little to no customization, this course covers AutoML. For more tailored machine learning capabilities, this course introduces Notebooks and BigQuery machine learning (BigQuery ML). Also, this course covers how to productionalize machine learning solutions by using Vertex AI.
In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.
In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.
While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.
This course introduces the Google Cloud big data and machine learning products and services that support the data-to-AI lifecycle. It explores the processes, challenges, and benefits of building a big data pipeline and machine learning models with Vertex AI on Google Cloud.
This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.
Learn how to use Gemini Notebook to create a personalized study guide for the Professional Data Engineer certification exam. You'll review Gemini Notebook features, create a notebook in Gemini Notebook, and learn how to use a study guide to practice for a certification exam.
Google Cloud 運算基本概念課程,適合幾乎沒有雲端運算背景或經驗的學員。這些課程會概略介紹雲端基礎知識、大數據和機器學習的核心概念,以及 Google Cloud 的角色和定位。完成這一系列課程後,學員將能闡述這些概念並展示實用技能。學員需依序完成課程: 1. Google Cloud 運算的基本概念:Cloud 運算基礎知識 2. Google Cloud 運算的基本概念:Google Cloud 基礎架構 3. Google Cloud 運算的基本概念:Google Cloud 的網路與安全性 4. Google Cloud 運算的基本概念:Google Cloud 中的資料、機器學習和 AI
只要修完「在 Google Cloud 設定應用程式開發環境」課程,就能獲得技能徽章。 在本課程中,您將學會如何使用以下技術的基本功能,建構和連結以儲存空間為中心的雲端基礎架構:Cloud Storage、Identity and Access Management、Cloud Functions 和 Pub/Sub。
各種規模的機構都開始運用雲端的強大功能和靈活性,徹底改變營運方式。不過,有效管理及擴充雲端資源可能是相當複雜的工作。本課程將探討在雲端中的現代營運、可靠性和韌性的基礎概念,以及 Google Cloud 如何協助您達成這些目標。本課程是 Cloud Digital Leader 學習路徑的一部分,旨在促進個人職能發展,並打造企業的未來。
許多傳統企業使用舊版系統和應用程式,無法滿足現今客戶的期望。企業主管經常需要在維護老舊的 IT 系統,以及投資新產品/服務之間做出選擇。本課程將探討這些挑戰,並提供解決方案,說明如何運用雲端技術克服難題。 本課程是 Cloud Digital Leader 學習路徑的一部分,旨在促進個人職能發展,並打造企業的未來。
In this course you will learn how you to harness serious Google Cloud power and infrastructure. The hands-on labs will give you use cases and you will be tasked with implementing scaling practices utilized by Google’s very own Solutions Architecture team. From developing enterprise grade load balancing and autoscaling, to building continuous delivery pipelines, Google Cloud Solutions I: Scaling your Infrastructure will teach you best practices for taking your Google Cloud projects to the next level.
完成 運用 Cloud Run 開發無伺服器應用程式 技能徽章中階課程, 即可證明您具備下列技能:整合 Cloud Run 和 Cloud Storage 以管理資料、 使用 Cloud Run 和 Pub/Sub 架構可復原的非同步系統、 使用 Cloud Run 建構 REST API 閘道,以及在 Cloud Run 建構及部署服務。
完成使用 BigQuery ML 為預測模型進行資料工程技能徽章中階課程, 即可證明自己具備下列知識與技能:運用 Dataprep by Trifacta 建構連至 BigQuery 的資料轉換 pipeline; 使用 Cloud Storage、Dataflow 和 BigQuery 建構「擷取、轉換及載入」(ETL) 工作負載, 以及使用 BigQuery ML 建構機器學習模型。
完成「在 Google Cloud 使用 Terraform 建構基礎架構」技能徽章中階課程, 即可證明自己具備下列知識與技能:使用 Terraform 的基礎架構即程式碼 (IaC) 原則、運用 Terraform 設定佈建及管理 Google Cloud 資源、有效管理狀態 (本機和遠端),以及將 Terraform 程式碼模組化,以利重複使用和管理。
完成 透過 BigQuery 建構資料倉儲 技能徽章中階課程,即可證明您具備下列技能: 彙整資料以建立新資料表、排解彙整作業問題、利用聯集附加資料、建立依日期分區的資料表, 以及在 BigQuery 使用 JSON、陣列和結構體。