Join Sign in

Lawrence Godfrey

Member since 2023

Diamond League

33380 points
Serverless Data Processing with Dataflow: Operations Earned Aug 31, 2024 EDT
使用 Knowledge Catalog 建構資料網格 Earned Mar 30, 2024 EDT
使用 BigQuery ML 為預測模型進行資料工程 Earned Mar 23, 2024 EDT
透過 BigQuery 建構資料倉儲 Earned Mar 17, 2024 EDT
Serverless Data Processing with Dataflow: Develop Pipelines Earned Mar 2, 2024 EST
Serverless Data Processing with Dataflow: Foundations Earned Feb 17, 2024 EST
Smart Analytics, Machine Learning, and AI on Google Cloud Earned Feb 11, 2024 EST
Build Streaming Data Pipelines on Google Cloud Earned Feb 4, 2024 EST
Build Batch Data Pipelines on Google Cloud Earned Jan 30, 2024 EST
Generative AI Fundamentals - 繁體中文 Earned Jan 26, 2024 EST
負責任的 AI 技術簡介 Earned Jan 25, 2024 EST
大型語言模型簡介 Earned Jan 25, 2024 EST
生成式 AI 簡介 Earned Jan 23, 2024 EST
Build Data Lakes and Data Warehouses on Google Cloud Earned Jan 22, 2024 EST
[DEPRECATED] Google Cloud Big Data and Machine Learning Fundamentals Earned Jan 16, 2024 EST
Build a Certification Study Guide: PDE Exam Prep Earned Jan 12, 2024 EST
在 Google Cloud 為機器學習 API 準備資料 Earned Jan 7, 2024 EST
Google Cloud 運算的基本概念：Google Cloud 中的資料、機器學習和 AI Earned Jan 7, 2024 EST

In the last installment of the Dataflow course series, we will introduce the components of the Dataflow operational model. We will examine tools and techniques for troubleshooting and optimizing pipeline performance. We will then review testing, deployment, and reliability best practices for Dataflow pipelines. We will conclude with a review of Templates, which makes it easy to scale Dataflow pipelines to organizations with hundreds of users. These lessons will help ensure that your data platform is stable and resilient to unanticipated circumstances.

Learn more

完成「使用 Knowledge Catalog 建構資料網格」技能徽章入門課程，即可證明您具備下列技能：使用 Knowledge Catalog 建構資料網格， 以利在 Google Cloud 維護資料安全性，並協助治理和探索資料。您將練習並測試自己的技能，包括在 Knowledge Catalog 為資產加上標記、指派 IAM 角色，以及評估資料品質。

Learn more

完成使用 BigQuery ML 為預測模型進行資料工程技能徽章中階課程， 即可證明自己具備下列知識與技能：運用 Dataprep by Trifacta 建構連至 BigQuery 的資料轉換 pipeline； 使用 Cloud Storage、Dataflow 和 BigQuery 建構「擷取、轉換及載入」(ETL) 工作負載， 以及使用 BigQuery ML 建構機器學習模型。

Learn more

完成 透過 BigQuery 建構資料倉儲 技能徽章中階課程，即可證明您具備下列技能： 彙整資料以建立新資料表、排解彙整作業問題、利用聯集附加資料、建立依日期分區的資料表， 以及在 BigQuery 使用 JSON、陣列和結構體。

Learn more

In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks.

Learn more

This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.

Learn more

Incorporating machine learning into data pipelines increases the ability to extract insights from data. This course covers ways machine learning can be included in data pipelines on Google Cloud. For little to no customization, this course covers AutoML. For more tailored machine learning capabilities, this course introduces Notebooks and BigQuery machine learning (BigQuery ML). Also, this course covers how to productionalize machine learning solutions by using Vertex AI.

Learn more

In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.

Learn more

In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.

Learn more

完成「Introduction to Generative AI」、「Introduction to Large Language Models」和「Introduction to Responsible AI」課程，即可獲得技能徽章。通過最終測驗，就能展現您對生成式 AI 基本概念的掌握程度。 「技能徽章」是 Google Cloud 核發的數位徽章，用於表彰您對 Google Cloud 產品和服務的相關知識。您可以將技能徽章公布在社群媒體的個人資料中，向其他人分享您的成果。

Learn more

這個入門微學習課程主要介紹「負責任的 AI 技術」和其重要性，以及 Google 如何在自家產品中導入這項技術。本課程也會說明 Google 的 7 個 AI 開發原則。

Learn more

這是一堂入門級的微學習課程，旨在探討大型語言模型 (LLM) 的定義和用途，並說明如何調整提示來提高 LLM 成效。此外，也會介紹多項 Google 工具，協助您自行開發生成式 AI 應用程式。

Learn more

這個入門微學習課程主要說明生成式 AI 的定義和使用方式，以及此 AI 與傳統機器學習方法的差異。本課程也會介紹各項 Google 工具，協助您開發自己的生成式 AI 應用程式。

Learn more

While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.

Learn more

This course introduces the Google Cloud big data and machine learning products and services that support the data-to-AI lifecycle. It explores the processes, challenges, and benefits of building a big data pipeline and machine learning models with Vertex AI on Google Cloud.

Learn more

Learn how to use Gemini Notebook to create a personalized study guide for the Professional Data Engineer certification exam. You'll review Gemini Notebook features, create a notebook in Gemini Notebook, and learn how to use a study guide to practice for a certification exam.

Learn more

完成 在 Google Cloud 為機器學習 API 準備資料 技能徽章入門課程，即可證明您具備下列技能： 使用 Dataprep by Trifacta 清理資料、在 Dataflow 執行資料管道、在 Managed Service for Apache Spark 建立叢集和執行 Apache Spark 工作，以及呼叫機器學習 API，包含 Cloud Natural Language API、Google Cloud Speech-to-Text API 和 Video Intelligence API。

Learn more

Google Cloud 運算基本概念課程，適合幾乎沒有雲端運算背景或經驗的學員。這些課程會概略介紹雲端基礎知識、大數據和機器學習的核心概念，以及 Google Cloud 的角色和定位。完成這一系列課程後，學員將能闡述這些概念並展示實用技能。學員需依序完成課程： 1. Google Cloud 運算的基本概念：Cloud 運算基礎知識 2. Google Cloud 運算的基本概念：Google Cloud 基礎架構 3. Google Cloud 運算的基本概念：Google Cloud 的網路與安全性 4. Google Cloud 運算的基本概念：Google Cloud 中的資料、機器學習和 AI 本系列的最後一堂課回顧了代管大數據服務、機器學習與這項技術的價值，以及如何獲得技能徽章，進一步展示您的 Google Cloud 技能。

Learn more