In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks.
各种规模的组织都在利用云的强大功能和灵活性来改变运营方式。然而,有效管理和扩缩云资源可能是一项复杂的任务。本课程探讨了云中现代运营、可靠性和弹性方面的基本概念,以及 Google Cloud 如何帮助支持这些工作。 作为 Cloud Digital Leader 学习路线的一部分,本课程旨在帮助个人在自己的岗位上成长,并为企业谋求未来发展。
许多传统企业都在使用无法满足现代客户期望的旧式系统和应用。业务领导者往往需要在维护老旧的 IT 系统和投资新产品与服务之间做出选择。本课程探讨了这些挑战,并提供了利用云技术克服这些挑战的解决方案。 作为 Cloud Digital Leader 学习路线的一部分,本课程旨在帮助个人在工作中成长,并为企业打造美好未来。
云技术是一项强大的资产,与数据相结合后,它将成为创新和提升客户体验的催化剂。《使用 Google Cloud 探索数据转换》课程探讨了组织如何利用云技术让数据更易于访问、更具实用价值和商业价值。 作为“Cloud Digital Leader 学习路线”的一部分,本课程旨在帮助个人提升职业素养,并为企业谋求未来发展。
数字化转型是现代组织的必经之路,而扎实掌握云计算基础知识,是推动实质性创新的第一步。《利用 Google Cloud 实现数字化转型》课程将讲解核心技术与战略框架,助力组织实现运营现代化。本课程介绍关于云的基本概念、全球网络基础设施和责任共担模式,帮助领导者从容推进上云进程。 作为 Cloud Digital Leader 学习路线的一部分,本课程旨在帮助学员提升岗位能力,从而为企业打造美好未来。
This course explores what ML is and what problems it can solve. The course also discusses best practices for implementing machine learning. You’re introduced to Vertex AI, a unified platform to quickly build, train, and deploy AutoML machine learning models. The course discusses the five phases of converting a candidate use case to be driven by machine learning, and why it’s important to not skip them. The course ends with recognizing the biases that ML can amplify and how to recognize them.
完成入门级技能徽章课程创建和管理 Bigtable 实例,展示以下方面的技能:创建实例、设计架构、 查询数据,以及在 Bigtable 中执行管理任务,包括监控性能、配置节点自动扩缩和复制。
完成创建和管理 Cloud Spanner 实例 这一入门级技能徽章课程,展示您在以下方面的技能: 创建 Cloud Spanner 实例和数据库并与之互动; 使用各种方法加载 Cloud Spanner 数据库; 备份 Cloud Spanner 数据库;定义架构并了解查询计划; 部署连接到 Cloud Spanner 实例的现代 Web 应用。
This course is intended to give architects, engineers, and developers the skills required to help enterprise customers architect, plan, execute, and test database migration projects. Through a combination of presentations, demos, and hands-on labs participants move databases to Google Cloud while taking advantage of various services. This course covers how to move on-premises, enterprise databases like SQL Server to Google Cloud (Compute Engine and Cloud SQL) and Oracle to Google Cloud bare metal.
“Google Cloud 基础知识:核心基础设施”介绍在使用 Google Cloud 时会遇到的重要概念和术语。本课程通过视频和实操实验来介绍并比较 Google Cloud 的多种计算和存储服务,并提供重要的资源和政策管理工具。
This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.
Incorporating machine learning into data pipelines increases the ability to extract insights from data. This course covers ways machine learning can be included in data pipelines on Google Cloud. For little to no customization, this course covers AutoML. For more tailored machine learning capabilities, this course introduces Notebooks and BigQuery machine learning (BigQuery ML). Also, this course covers how to productionalize machine learning solutions by using Vertex AI.
In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.
In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.
完成“在 Google Cloud 上设置应用开发环境”课程,赢取技能徽章;通过该课程,您将了解如何使用以下技术的基本功能来构建和连接以存储为中心的云基础设施: Cloud Storage、Identity and Access Management、Cloud Functions 和 Pub/Sub。
Big data, machine learning, and scientific data? It sounds like the perfect match. In this course, you will get hands-on practice with GCP services like BigQuery, Managed Service for Apache Spark, and Tensorflow by applying them to use cases that employ real-life, scientific data sets. By getting experience with tasks like earthquake data analysis and satellite image aggregation, Scientific Data Processing will expand your skill set in big data and machine learning so you can start tackling your own problems across a spectrum of scientific disciplines.
In this course you will learn how to use several BigQuery ML features to improve retail use cases. Predict the demand for bike rentals in NYC with demand forecasting, and see how to use BigQuery ML for a classification task that predicts the likelihood of a website visitor making a purchase.
While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.
Learn how to use Gemini Notebook to create a personalized study guide for the Professional Data Engineer certification exam. You'll review Gemini Notebook features, create a notebook in Gemini Notebook, and learn how to use a study guide to practice for a certification exam.
This course introduces the Google Cloud big data and machine learning products and services that support the data-to-AI lifecycle. It explores the processes, challenges, and benefits of building a big data pipeline and machine learning models with Vertex AI on Google Cloud.
完成入门级技能徽章课程在 Google Cloud 上为机器学习 API 准备数据,展示以下技能: 使用 Dataprep by Trifacta 清理数据、在 Dataflow 中运行数据流水线、在 Managed Service for Apache Spark 中创建集群和运行 Apache Spark 作业,以及调用机器学习 API,包括 Cloud Natural Language API、Google Cloud Speech-to-Text API 和 Video Intelligence API。
大数据、机器学习和人工智能是当今计算领域的热门话题, 但这些领域的专业性很强,因而很难找到 入门资料。幸运的是,Google Cloud 在这些领域提供了方便用户使用的服务, 通过本入门级课程,您可以 开始学习使用 BigQuery、Cloud Speech API 和 Video Intelligence 等工具。
完成入门级技能徽章课程创建和管理 AlloyDB 实例,展示您在以下方面的技能:执行核心 AlloyDB 操作 和任务、从 PostgreSQL 迁移到 AlloyDB、管理 AlloyDB 数据库,以及 使用 AlloyDB 列式引擎加速分析查询。
想要仅使用 SQL 就能在几分钟内构建机器学习模型,而不是花费数小时?BigQuery 借助机器学习,数据分析师能够使用现有的 SQL 工具和技能创建、训练、评估机器学习模型,并使用这些模型进行预测, 从而实现机器学习的普及。在 本系列实验中,您将尝试不同的模型类型,并了解 如何构建出色的模型。
在本入门级课程中,您将了解 Google Cloud 的基础工具和服务。此课程提供了可选视频, 旨在帮助您深入了解和回顾实验中涉及的概念。Google Cloud 基础知识是推荐给 Google Cloud 学员的第一门课程 - 即使您几乎没有云相关知识,也能从中获得实践 经验,并将其直接运用于您的首个 Google Cloud 项目。从编写 Cloud Shell 命令和部署您的第一个虚拟机,到在 Kubernetes Engine 上运行应用 或者使用负载均衡,“Google Cloud 基础知识”都是您了解该平台 基本功能的首选入门级课程。
In this fundamental-level course, you will learn the ins and outs of Google Cloud's operations suite running on Google Kubernetes Engine, an important service for generating insights into the health of your applications. It provides a wealth of information in application monitoring, report logging, and diagnoses. The labs in this course will give you hands-on practice with and will teach you how to monitor virtual machines, generate logs and alerts, and create custom metrics for application data. It is recommended that the students have at least earned a Badge by completing the Google Cloud Essentials course. Additional lab experience with the labs in the Baseline - Infrastructure course will also be useful. Looking for a hands-on challenge lab to demonstrate your skills and validate your knowledge? On completing this course, enroll in and finish the additional challenge lab at the end of this course to receive an exclusive Google Cloud digital badge.
Want to scale your data analysis efforts without managing database hardware? Learn the best practices for querying and getting insights from your data warehouse with this interactive series of BigQuery labs. BigQuery is Google's fully managed, NoOps, low cost analytics database. With BigQuery you can query terabytes and terabytes of data without having any infrastructure to manage or needing a database administrator. BigQuery uses SQL and can take advantage of the pay-as-you-go model. BigQuery allows you to focus on analyzing data to find meaningful insights.
In this series of labs you will learn how to use BigQuery to analyze NCAA basketball data with SQL. Build a Machine Learning Model to predict the outcomes of NCAA March Madness basketball tournament games.
In this quest you will get hands-on experience writing infrastructure as code with Terraform.