加入 登录

Shanmugapriya GOOGLEUSER

成为会员时间:2025

钻石联赛

6838 积分
Serverless Data Processing with Dataflow: Operations Earned Nov 14, 2025 EST
Build Streaming Data Pipelines on Google Cloud Earned Nov 3, 2025 EST
Build Batch Data Pipelines on Google Cloud Earned Oct 13, 2025 EDT
Serverless Data Processing with Dataflow: Foundations Earned Oct 13, 2025 EDT
Build Data Lakes and Data Warehouses on Google Cloud Earned Sep 23, 2025 EDT
实现事件驱动的即时消息和自动化工作流 Earned Sep 10, 2025 EDT
Google Cloud 数据工程简介 Earned Sep 1, 2025 EDT
Google Cloud 云计算基础课程:云计算基础知识 Earned Aug 12, 2025 EDT

In the last installment of the Dataflow course series, we will introduce the components of the Dataflow operational model. We will examine tools and techniques for troubleshooting and optimizing pipeline performance. We will then review testing, deployment, and reliability best practices for Dataflow pipelines. We will conclude with a review of Templates, which makes it easy to scale Dataflow pipelines to organizations with hundreds of users. These lessons will help ensure that your data platform is stable and resilient to unanticipated circumstances.

了解详情

In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.

了解详情

In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.

了解详情

This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.

了解详情

While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.

了解详情

完成 实现事件驱动的即时消息和自动化工作流技能徽章课程,赢取技能徽章。 在这门课程中,您将学习如何通过 Cloud 控制台使用 Pub/Sub、如何使用 Cloud Scheduler 作业减轻工作量,以及在哪些用例中可以使用 Pub/Sub Lite 来节省大量事件提取的开支。

了解详情

在本课程中,您将了解 Google Cloud 数据工程、数据工程师的角色和职责,以及相关的 Google Cloud 产品和服务。您还将了解如何应对数据工程挑战。

了解详情

Google Cloud 云计算基础课程面向云计算零基础或经验较少的人群。本课程概述了云计算基础知识、大数据和机器学习的核心概念,以及 Google Cloud 在其中的定位与应用方式。 完成本系列课程后,学员将能够清晰阐述这些概念,并掌握部分实操技能。 课程应按以下顺序完成: 1. Google Cloud 云计算基础课程:云计算基础知识 2. Google Cloud 云计算基础课程:Google Cloud 中的基础设施 3. Google Cloud 云计算基础课程:Google Cloud 中的网络服务和安全性 4. Google Cloud 云计算基础课程:Google Cloud 中的数据、机器学习和 AI 本课是第一门课程,概述了云计算、Google Cloud 的使用方式以及各种计算选项。

了解详情