Join Sign in

Viacheslav Melnyk

Member since 2022

Gold League

25305 points
Serverless Data Processing with Dataflow: Operations Earned дек. 20, 2023 EST
Serverless Data Processing with Dataflow: Develop Pipelines Earned дек. 18, 2023 EST
Serverless Data Processing with Dataflow: Foundations Earned окт. 22, 2023 EDT
Build a Data Warehouse with BigQuery Earned февр. 24, 2023 EST
Implement Cloud Security Fundamentals on Google Cloud Earned февр. 23, 2023 EST
Migrate MySQL Data to Cloud SQL Using Database Migration Service Earned февр. 23, 2023 EST
Perform Predictive Data Analysis in BigQuery Earned февр. 21, 2023 EST
Share Data Using Google Data Cloud Earned февр. 20, 2023 EST
Manage Data Models in Looker Earned февр. 12, 2023 EST
Build LookML Objects in Looker Earned февр. 11, 2023 EST
Create ML Models with BigQuery ML Earned февр. 11, 2023 EST
Derive Insights from BigQuery Data Earned февр. 10, 2023 EST
Prepare Data for Looker Dashboards and Reports Earned февр. 10, 2023 EST
Develop Serverless Apps with Firebase Earned дек. 2, 2022 EST
Develop Serverless Applications on Cloud Run Earned дек. 2, 2022 EST
Optimize Costs for Google Kubernetes Engine Earned дек. 1, 2022 EST
Build Infrastructure with Terraform on Google Cloud Earned нояб. 10, 2022 EST
Build a Certification Study Guide: PCA Exam Prep Earned нояб. 10, 2022 EST
Deploy Kubernetes Applications on Google Cloud Earned нояб. 8, 2022 EST
Implementing Cloud Load Balancing for Compute Engine Earned окт. 28, 2022 EDT
Build a Website on Google Cloud Earned окт. 28, 2022 EDT
Engineer Data for Predictive Modeling with BigQuery ML Earned окт. 27, 2022 EDT
Set Up a Google Cloud Network Earned окт. 21, 2022 EDT
Develop Your Google Cloud Network Earned окт. 18, 2022 EDT
Prepare Data for ML APIs on Google Cloud Earned окт. 14, 2022 EDT
Set Up an App Dev Environment on Google Cloud Earned окт. 11, 2022 EDT

In the last installment of the Dataflow course series, we will introduce the components of the Dataflow operational model. We will examine tools and techniques for troubleshooting and optimizing pipeline performance. We will then review testing, deployment, and reliability best practices for Dataflow pipelines. We will conclude with a review of Templates, which makes it easy to scale Dataflow pipelines to organizations with hundreds of users. These lessons will help ensure that your data platform is stable and resilient to unanticipated circumstances.

Learn more

In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks.

Learn more

This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.

Learn more

Complete the intermediate Build a Data Warehouse with BigQuery skill badge course to demonstrate skills in the following: joining data to create new tables, troubleshooting joins, appending data with unions, creating date-partitioned tables, and working with JSON, arrays, and structs in BigQuery.

Learn more

Complete the intermediate Implement Cloud Security Fundamentals on Google Cloud skill badge course to demonstrate skills in the following: creating and assigning roles with Identity and Access Management (IAM); creating and managing service accounts; enabling private connectivity across virtual private cloud (VPC) networks; restricting application access using Identity-Aware Proxy; managing keys and encrypted data using Cloud Key Management Service (KMS); and creating a private Kubernetes cluster.

Learn more

Complete the introductory Migrate MySQL Data to Cloud SQL Using Database Migration Service skill badge course to demonstrate skills in the following: migrating MySQL data to Cloud SQL using different job types and connectivity options available in Database Migration Service and migrating MySQL user data when running Database Migration Service jobs.

Learn more

Complete the intermediate Perform Predictive Data Analysis in BigQuery skill badge course to demonstrate skills in the following: creating datasets in BigQuery by importing CSV and JSON files; harnessing the power of BigQuery with sophisticated SQL analytical concepts, including using BigQuery ML to train an expected goals model on soccer event data and evaluate the impressiveness of World Cup goals.

Learn more

Earn a skill badge by completing the Share Data Using Google Data Cloud skill badge course, where you will gain practical experience with Google Cloud Data Sharing Partners, which have proprietary datasets that customers can use for their analytics use cases. Customers subscribe to this data, query it within their own platform, then augment it with their own datasets and use their visualization tools for their customer facing dashboards.

Learn more

Complete the intermediate Manage Data Models in Looker skill badge course to demonstrate skills in the following: maintaining LookML project health; utilizing SQL runner for data validation; employing LookML best practices; optimizing queries and reports for performance; and implementing persistent derived tables and caching policies.

Learn more

Complete the introductory Build LookML Objects in Looker skill badge course to demonstrate skills in the following: building new dimensions and measures, views, and derived tables; setting measure filters and types based on requirements; updating dimensions and measures; building and refining Explores; joining views to existing Explores; and deciding which LookML objects to create based on business requirements.

Learn more

Complete the intermediate Create ML Models with BigQuery ML skill badge to demonstrate skills in creating and evaluating machine learning models with BigQuery ML to make data predictions.

Learn more

Complete the introductory Derive Insights from BigQuery Data skill badge course to demonstrate skills in the following: Write SQL queries.Query public tables.Load sample data into BigQuery.Troubleshoot common syntax errors with the query validator in BigQuery.Create reports in Data Studio by connecting to BigQuery data.

Learn more

Complete the introductory Prepare Data for Looker Dashboards and Reports skill badge course to demonstrate skills in the following: filtering, sorting, and pivoting data; merging results from different Looker Explores; and using functions and operators to build Looker dashboards and reports for data analysis and visualization.

Learn more

Complete the intermediate Develop Serverless Apps with Firebase skill badge course to demonstrate skills in the following: architecting and building serverless web applications with Firebase, utilizing Firestore for database management, automating deployment processes using Cloud Build, and integrating Google Assistant functionality into your applications.

Learn more

Complete the intermediate Develop Serverless Applications on Cloud Run skill badge course to demonstrate skills in the following: integrating Cloud Run with Cloud Storage for data management, architecting resilient asynchronous systems using Cloud Run and Pub/Sub, constructing REST API gateways powered by Cloud Run, and building and deploying services on Cloud Run.

Learn more

Complete the intermediate Optimize Costs for Google Kubernetes Engine skill badge course to demonstrate skills in the following: creating and managing multi-tenant clusters, monitoring resource usage by namespace, configuring cluster and pod autoscaling for efficiency, setting up load balancing for optimal resource distribution, and implementing liveness and readiness probes to ensure application health and cost-effectiveness.

Learn more

Complete the intermediate Build Infrastructure with Terraform on Google Cloud skill badge to demonstrate skills in the following: Infrastructure as Code (IaC) principles using Terraform, provisioning and managing Google Cloud resources with Terraform configurations, effective state management (local and remote), and modularizing Terraform code for reusability and organization.

Learn more

Learn how to use Gemini Notebook to create a personalized study guide for the Professional Cloud Architect certification exam. You'll review Gemini Notebook features, create a notebook in Gemini Notebook, and learn how to use a study guide to practice for a certification exam.

Learn more

Complete the intermediate Deploy Kubernetes Applications on Google Cloud skill badge course to demonstrate skills in the following: Configuring and building Docker container images.Creating and managing Google Kubernetes Engine (GKE) clusters.Utilizing kubectl for efficient cluster management.Deploying Kubernetes applications with robust continuous delivery (CD) practices.

Learn more

Complete the introductory Implementing Cloud Load Balancing for Compute Engine skill badge to demonstrate skills in the following: creating and deploying virtual machines in Compute Engine and configuring network and application load balancers.

Learn more

Earn the introductory skill badge by completing the Build a Website on Google Cloud skill badge course. This course is based on the Get Cooking in Cloud series and covers`:`Deploying a website on Cloud RunHosting a web app on Compute EngineCreating, deploying, and scaling your website on Google Kubernetes EngineMigrating from a monolithic application to a microservices architecture using Cloud Build

Learn more

Complete the intermediate Engineer Data for Predictive Modeling with BigQuery ML skill badge to demonstrate skills in the following: building data transformation pipelines to BigQuery using Dataprep by Trifacta; using Cloud Storage, Dataflow, and BigQuery to build extract, transform, and load (ETL) workflows; and building machine learning models using BigQuery ML.

Learn more

Earn a skill badge by completing the Set Up a Google Cloud Network skill badge course, where you will learn how to perform basic networking tasks on Google Cloud Platform - create a custom network, add subnets firewall rules, then create VMs and test the latency when they communicate with each other.

Learn more

Earn a skill badge by completing the Develop your Google Cloud Network skill badge course, where you learn multiple ways to deploy and monitor applications including how to: explore IAM roles and add/remove project access, create VPC networks, deploy and monitor Compute Engine VMs, write SQL queries, deploy and monitor VMs in Compute Engine, and deploy applications using Kubernetes with multiple deployment approaches.

Learn more

Complete the introductory Prepare Data for ML APIs on Google Cloud skill badge to demonstrate skills in the following: cleaning data with Dataprep by Trifacta, running data pipelines in Dataflow, creating clusters and running Apache Spark jobs in Managed Service for Apache Spark, and calling ML APIs including the Cloud Natural Language API, Google Cloud Speech-to-Text API, and Video Intelligence API.

Learn more

Earn a skill badge by completing the Set Up an App Dev Environment on Google Cloud skill badge course, where you learn how to build and connect storage-centric cloud infrastructure using the basic capabilities of the following technologies: Cloud Storage, Identity and Access Management, Cloud Functions, and Pub/Sub.

Learn more