Francisco Colomer
Member since 2023
Diamond League
56397 points
Member since 2023
In this advanced challenge lab, you act as a Data Engineer for Cymbal Direct, a retail company integrating real-time movie review data into a marketing pipeline. You are responsible for building two distinct streaming architectures. First, you will implement a direct, code-free ingestion path using Pub/Sub BigQuery subscriptions. Second, you will deploy a sophisticated Dataflow pipeline that uses JavaScript User-Defined Functions (UDFs) to transform raw text into numerical data before it reaches BigQuery, all while managing high-velocity data generated by a simulated stream.
Complete the Orchestrate Data Lifecycle Automation with Data Agents skill badge to demonstrate your proficiency in modernizing data infrastructure using AI-driven automation. Emphasis is placed on acting as an 'Agent Orchestrator'—leveraging specialized Data Agents to build resilient Dataform pipelines, enforce Dataplex governance, and accelerate data science workflows in Colab Enterprise. A skill badge is an exclusive digital badge issued by Google Cloud in recognition of your proficiency with Google Cloud products and services and tests your ability to apply your knowledge in an interactive hands-on environment. Complete the assessment challenge lab to receive a skill badge that you can share with your network. When you complete this course, you can earn the badge displayed here and claim it on Credly! Boost your cloud career by showing the world the skills you have developed!
In this introductory course, you'll learn how Looker can help you explore, analyze, and visualize your data to drive better decisions. Through a combination of video lectures and demos, you'll discover how to connect to various data sources, build interactive dashboards, and perform effective data analysis. Whether you're a data analyst, BI analyst, data scientist or business user, this course will equip you with the foundational knowledge to start using Looker effectively, regardless of your background.
建立您的第一個 Gemini Enterprise 應用程式,獲得技能徽章!將各種資料來源連接到您的應用程式,建立強大的統合式搜尋和分析引擎。掌握 Deep Research 代理、多代理構思和 NotebookLM 等進階功能,進行重點分析。
瞭解 AI 代理如何發揮更高的業務影響力,包括根據您的 KPI 規劃要使用的代理類型,以及探索能解決實際瓶頸的用途。您也將認識各種無程式碼到高程式碼解決方案,瞭解 Gemini Enterprise 如何協助建構和自動調度合適的代理。
AI 代理是超越傳統大型語言模型 (LLM) 的重大轉變,這類服務不僅可以生成以文字為基礎的解決方案,還能自主加以執行。本課程介紹 AI 代理的基礎知識、與 LLM API 的差異,以及在實際應用上帶來的價值。本課程內容奠基於 Google 的代理白皮書,介紹實際編寫代理程式碼之前所需的理論基礎,非常適合有意透過目標導向自主行為 (不僅限於文字生成) 來理解 AI 系統的開發人員、架構師和技術決策者。加入社群論壇,提出問題並參與討論。
瞭解 AI 代理的概念,探索代理如何藉由自主行動及推論解決複雜問題。您將瞭解代理如何透過模型、工具和調度管理程序等技術架構,助您學習、規劃和實現目標。
This course introduces you to event-based applications and teaches you how to use service orchestration and choreography to coordinate microservices. Using lectures and hands-on labs, you learn how to use Workflows, Eventarc, Cloud Tasks, and Cloud Scheduler to build microservices applications on Google Cloud.
In this course, you learn the fundamentals of application development on Google Cloud. You learn best practices for cloud applications, and how to select compute and data options to match your application use cases. You're introduced to generative AI and how it's used to help build applications. You learn about authentication and authorization, application deployment, continuous integration and delivery, and monitoring and performance tuning for your applications running in Google Cloud. Using lectures and hands-on labs, you learn how to get started building and running applications on Google Cloud.
瞭解如何使用 Agent Development Kit (ADK),建構複雜的 AI 代理並用於正式環境。本課程介紹 ADK 的開放原始碼框架,包括簡單的提示工程,以及程式碼優先的結構化軟體開發做法 (適用於企業級多代理系統)。
完成「透過 Google AI Studio 開發 AI 輔助原型」技能徽章入門課程,證明您具備下列技能:編寫有效的提示詞、運用多模態功能分析圖像和影片、 依據範本和文字提示詞設計可運作的 AI 應用程式原型,以及使用 API 金鑰建構及部署自訂 AI 解決方案。
In this video, you'll learn to use Gemini in Google Sheets for advanced data analysis. You'll learn how to create data visualizations, like a scatter plot, using a simple prompt. You'll also learn how to ask Gemini to analyze your data for strategic insights and recommendations, such as how to save money.
In this video, you'll learn to use Gemini in Google Sheets to automatically generate organized trackers from unstructured data. You'll learn how to write a prompt that references other Google Drive files using the "@" symbol. You'll also see how Gemini builds a fully formatted, color-coded table with drop-down menus based on the data in your notes, saving you significant manual effort.
In this video, you'll learn to use Gemini in Google Workspace to manage your calendar from your Gmail inbox. You'll learn how to ask Gemini about your schedule in the side panel and how to create new events without switching apps. You'll also learn how to use Gemini's one-click scheduling feature when it automatically detects event details in an email.
In this video, you'll learn to use Gemini in Google Slides to build polished presentations efficiently. You'll see how to create slides by referencing content directly from your Google Drive files using the "@" symbol. You'll also learn to generate custom, professional images from a simple text prompt to visually enhance your presentation.
In this video, you'll learn to use the "Ask Gemini" feature in Google Sheets to manage your data with natural language. You'll see how to ask Gemini to create dropdowns, highlight sales data, create a pivot table, filter by month, and sort by revenue.
In this video, you'll learn to use the =AI() function in Google Sheets to automate your work. You'll see how to generate text like slogans, summarize paragraphs of customer feedback, and categorize data by classifying inquiries and analyzing sentiment.
In this video, you'll learn to create "what if" scenarios using AI's reasoning. You'll see how to set a "before" scene with a person holding a cake, prompt an action by asking "what would happen if they tripped?", and let the AI generate the plausible "after" image of the cake falling.
In this video, you'll learn the "creative mashup artist" technique for combining images. You'll see how to generate a subject and a scene as two separate images, and then use a final blending prompt to fuse the astronaut from the first image and the court from the second into one new picture.
In this video, you'll learn to art direct your images in the Gemini app. You'll see how to use multi-turn editing to furnish an empty room step-by-step, and how to "remix" a photo by applying the color and texture of a butterfly's wings to a pair of rainboots.
In this video, you'll learn to create imaginative portraits in the Gemini app that maintain your likeness. You'll see how to use the "Subject, Action, Scene, Style" formula for better prompts, transport yourself into a vintage photo, and combine a photo of yourself and your dog into one new image.
In this video, you'll learn to use NotebookLM to manage a large-scale research project. You'll see how to upload all your documents to get summaries, ask deeper strategic questions to find key insights, and use the audio feature to listen to your findings on the go.
In this video, you'll learn to use NotebookLM to analyze raw data and find compelling stories. You'll see how to ground the AI in your specific documents, prompt it to generate newsworthy PR claims, and ask it to find hidden correlations between different data points to uncover new insights.
In this video, you'll learn to use an AI assistant to streamline large-scale event planning. You'll see how to prompt an AI to brainstorm off-site ideas, create fair groups for icebreakers, build a shuttle schedule based on arrival times, and analyze survey feedback for gains and losses.
In this video, you'll learn pro tips for conducting thorough competitive research with Gemini Deep Research. You'll see how to enhance a basic prompt by assigning a persona, specifying a table format for the output, and directing the AI to search specific sources like Reddit for richer insights.
In this video, you'll learn to use Gemini Deep Research to make complex purchasing decisions with confidence. You'll see how to write a nuanced, personal prompt about your specific needs and receive a synthesized, comparative report that cuts through the clutter of online reviews.
In this video, you'll learn to create an animated bar chart race using Gemini Canvas. You'll see how to write a prompt to visualize data over time and then use a follow-up prompt to refine the animation, such as slowing it down for a presentation.
In this video, you'll learn to create complex animated art using Gemini Canvas. You'll see how to write a descriptive prompt to generate a kinetic typography animation with distortion effects, and then use a follow-up prompt to completely change its color style.
In this video, you'll learn to build a reusable, custom "Study Guide Gem." You'll see how to write the core instructions for your Gem once, and then use it again and again to transform messy notes and articles into a perfectly structured study guide with a summary, outline, and glossary.
In this video, you'll learn to turn your study guides into interactive quizzes using Gemini Canvas. You'll see how to upload your notes and use a simple prompt to generate a quiz with multiple choice and fill-in-the-blank questions that provide immediate feedback.
In this video, you'll learn to use Gemini Deep Research to conduct competitive marketing analysis. You'll see how to submit a research prompt, approve the personalized research plan Gemini creates, and receive a detailed, synthesized report on competitor campaigns to inform your strategy.
In this video, you'll learn to build a working prototype of a personalized weather app using Gemini Canvas. You'll see how to specify the cities for a 7-day forecast and then use a follow-up prompt to change the app's theme to a minimal, dark mode interface.
In this video, you'll learn to create an interactive 3D simulation using Gemini Canvas. You'll see how to build a 3D model of the solar system from a single sentence and then use follow-up prompts to add interactive and educational features, like clickable planets and fun facts.
In this video, you'll learn to build a custom personal utility app using Gemini Canvas. You'll see how to write a detailed prompt to create a Pomodoro timer tailored to your specific needs, and then use follow-up prompts to adjust its visual design.
In this video, you'll learn to use the Guided Learning experience in Gemini to build a deep understanding of any topic. You'll see how to start a conversation, engage with Gemini's probing questions, and use interactive tools like diagrams and quizzes to guide your learning journey.
In this video, you'll learn to use a simple text prompt in Gemini Canvas to build a playable game. You'll see how to create a Tic-Tac-Toe game, use a follow-up prompt to customize its theme to a retro 8-bit style, and share the final game with a link.
In this video, you'll learn to use creative prompts in Gemini to make complex research fun and easy to understand. You'll see how to ask Gemini to research a topic and present the findings in a creative format, like a sports scouting report and a head-to-head bracket, to better visualize and compare your options.
In this video, you'll learn to use the Create menu in Gemini Canvas to instantly convert a block of text into a variety of visual formats. You’ll see how to take a brainstormed marketing campaign and turn it into both a shareable infographic and an internal webpage with just one click.
In this video, you'll learn to use Gemini Canvas to turn a simple drawing into a working app. You'll upload a sketch, use a simple prompt to generate code, watch a live preview build itself, and make iterative changes to your app prototype using natural language.
This video covers how NotebookLM's Reports feature dynamically suggests formats to help you create customized, trustworthy analyses of your documents with ease.
This video covers how to build a personalized "Work with Me" agent using Gemini Gems, which helps streamline foundational feedback and makes your meetings more strategic and efficient.
AI Boost Bites is a video series designed to help you leverage Google's AI tools in your daily work. Each episode, under 10 minutes, features a quick video demonstrating a real-world AI use case or topic. After the video, you'll get a challenge to apply what you've learned. It's an easy, interactive way to boost your AI skills and improve your productivity.
This video covers how to create a 'project notebook' in NotebookLM by adding all relevant sources to build a central, searchable knowledge hub for your team.
This video covers how to use NotebookLM for common marketing tasks like analyzing customer feedback, conducting market research, and generating content ideas.
This video covers how to use the Video Overviews feature in NotebookLM to automatically generate a short explainer video based on your source documents.
This video covers how to use the 'Discover Sources' feature in NotebookLM to find and import relevant web-based sources directly into your research project.
This video covers how to use the Mind Maps feature in NotebookLM to automatically create a visual representation of your sources, helping you understand connections and key concepts.
This video covers how to use NotebookLM as a personal research assistant by adding sources, asking questions, and generating new content formats based on your documents.
This video covers how to use Gemini in Gmail to draft new emails, refine their tone, respond with context from Drive files, and use smart reply suggestions.
This video covers how to use the 'Help me create' feature in Google Docs to generate a complete, formatted document by referencing content from other files in your Drive.
This video covers five key ways to use Google's AI tools, including Gemini in Workspace, the Gemini app, and NotebookLM, to enhance your daily productivity.
This video covers how to use Gemini in Gmail to summarize emails, find information, and draft replies, helping you manage your inbox more efficiently.
This video covers how to use Gemini in Slides to automatically generate meeting recaps and draft follow-up emails, which can streamline your post-meeting workflow and save you time.
This video covers how you can leverage Gemini's advanced AI capabilities within Google Sheets to effortlessly pull data and generate insights in minutes, all without the need for any technical or coding background.
This video will cover how to leverage Gemini Gems to create authentic social media posts in your leader's unique voice. Learn to overcome the challenge of scaling executive social presence by training a Gem with writing samples and clear instructions. Discover how to generate engaging posts quickly, saving time while amplifying thought leadership and ensuring authenticity.
This video covers how you can create your own Brevity Gem to summarize and transform messy notes or long documents into clear, concise, executive-ready summaries.
This video covers how to use Gemini and Apps Script to automate manual tasks across Google Workspace. You'll learn to prompt Gemini to generate Apps Script code that automatically drafts email reminders in Google Sheets for tasks not marked 'Complete.' Automate your workflow with little to no technical expertise, freeing up time for more important work and eliminating manual follow-ups.
This video covers how you can leverage Notebook LM to "eat the frog" on your to-do list by automating complex tasks like summarizing legislation and mapping services, saving you hours of work.
This video covers how to eliminate tedious manual data entry using Gemini. Learn how to take a picture or screenshot of data (from PDFs, paper, or images) and prompt Gemini to instantly convert it into a structured Google Sheet. Discover this simple hack to save countless hours transcribing data, turning Gemini into your personal data entry assistant. Just snap, prompt, and export!
AI Boost Bites is a video series designed to help you leverage Google's AI tools in your daily work. Each episode, under 10 minutes, features a quick video demonstrating a real-world AI use case or topic. After the video, you'll get a challenge to apply what you've learned. It's an easy, interactive way to boost your AI skills and improve your productivity.
This video will cover how to use NotebookLM to gather and analyze publicly available information, combine it with internal documents, and extract key competitive insights.
This video covers how to personalize your Gemini results in Google Workspace. Learn to incorporate documents and research papers directly into your prompts using the "@" symbol to get more targeted and relevant AI output tailored to your needs.
This video covers how you can use Gemini to summarize long documents in Google Workspace, so you can quickly get the information you need and save time. You'll learn how to use Gemini to summarize entire documents or just selected text, as well as how to use Gemini in Drive to summarize across multiple files.
This video covers prompt engineering fundamentals for effective AI communication. Learn a simple framework (Persona, Task, Context, Format) to craft clear prompts, getting better, faster results from Gemini in Google Workspace. Discover how to use natural language, be specific, and iterate for optimal AI assistance.
This video will cover how you can leverage Gemini's advanced AI capabilities in Google Docs to brainstorm ideas, draft various marketing content, and collaborate with your team.
This video covers how NotebookLM can revolutionize customer insight gathering from call or chat transcripts. You'll learn to upload PDF transcripts of hundreds of conversations (even multilingual ones!) and quickly extract key themes, trending topics, and actionable insights without listening for hours. Discover how to save findings, share notebooks, and even generate interactive podcast summaries of your data.
This video covers how to create your own Gemini Gems, advanced AI capabilities that can automate repetitive tasks and supercharge your productivity.
In this course, you'll learn how to build software with Gemini, Google’s generative AI. The best part is: Anyone can do this. It’s okay if you've never written code before. You just need to be curious and motivated, and we'll help you get from zero to app.
In this video, you'll learn to build a working music synthesizer using a simple text prompt in Gemini Canvas. You'll see how to specify controls like waveform, attack, and sustain, and then interact with the generated instrument to create and experiment with your own unique sounds.
完成「透過直覺式程式開發和 MCP,建構智慧雲端應用程式」課程,即可獲得技能徽章。在本課程中,您將學會如何利用 Google AI 程式設計助理和 MCP 伺服器的強大功能。
Complete the Streamline Application Development with Gemini CLI skill badge to demonstrate your proficiency in using the full capabilities of Gemini CLI in application development tasks. You will be tasked with defining multi-step plans, creating a reusable CLI extension, managing context, experimenting with checkpoints and deploying to Cloud Run all from Gemini CLI. A skill badge is an exclusive digital badge issued by Google Cloud in recognition of your proficiency with Google Cloud products and services and tests your ability to apply your knowledge in an interactive hands-on environment. Complete the assessment challenge lab, to receive a skill badge that you can share with your network. When you complete this course, you can earn the badge displayed here and claim it on Credly! Boost your cloud career by showing the world the skills you have developed!
這門課程適合應用程式開發人員和 DevOps 工程師,您將學會如何運用 Gemini CLI (終端機適用並採用 Gemini 技術的生成式 AI 代理),以更聰明的方式處理工作。這門課程會說明 Gemini CLI 的安裝方式與設定、介紹用途和安全性最佳做法,並解釋指令、工具、MCP 伺服器和擴充功能。在實作練習,您會安裝及設定 Gemini CLI,藉此分析程式碼,還有建構及修改應用程式。
歡迎來到「AI 基礎架構:網路技術」課程。本課程將說明如何運用 Google Cloud 的高頻寬、低延遲基礎架構,最佳化調整 AI 系統所有元件之間的資料傳輸和通訊。最後,您將掌握網路在整個 AI 管道 (從資料擷取、訓練到推論) 發揮的關鍵作用,並採取最佳做法,確保工作負載能以最高速度運作。
在本課程中,您將全面瞭解 Google Cloud 提供的儲存空間解決方案,專門用於 AI 和高效能運算 (HPC) 的工作負載。您將學習如何根據機器學習生命週期的各個階段,選擇合適的儲存空間;以及探索如何在訓練期間將 I/O 效能最佳化、管理準備資料所需的龐大資料集,以及用低延遲提供模型構件。透過實際例子和示範,您將掌握專業知識,得以設計穩健的儲存空間解決方案,並加快 AI 創新。
這堂課程會完整說明如何在 Google Cloud 部署、管理及最佳化調整 AI 和高效能運算 (HPC) 工作負載。藉由一系列課堂和實務示範,您會瞭解不同的部署策略,從使用 Google Compute Engine (GCE) 的高度可自訂環境,到 Google Kubernetes Engine (GKE) 等代管解決方案。具體來說,您會學到如何建立叢集及部署 GKE,以便執行推論工作。
歡迎來到 Cloud TPU 課程。我們將探討在各種情境下使用 TPU 的優缺點,並比較不同的 TPU 加速器,協助您選擇合適的工具。您將瞭解如何盡可能提高 AI 模型的效能和效率,以及互通的 GPU/TPU 對於打造靈活的機器學習工作流程有多重要。我們會透過引人入勝的內容和實際演示,一步步引導您有效運用 TPU。
想瞭解 AI 背後的強大硬體嗎?本單元將深入解析針對效能最佳化的 AI 電腦,說明其重要性。我們將探討 CPU、GPU 和 TPU 如何大幅加速 AI 任務運算,分析各自的特點,以及 AI 軟體如何充分利用這些硬體效能。單元結束後,您將清楚掌握如何根據 AI 專案挑選合適的 GPU,並做出明智的 AI 工作負載決策。
準備開始使用 AI Hypercomputer 了嗎?這門課程可讓您快速上手!我們將介紹這個架構的基本概念,以及此架構如何幫助 AI 處理 AI 工作負載。您將瞭解 Hypercomputer 內的不同元件,例如 GPU、TPU 和 CPU,以及如何視需求選擇合適的部署方法。
In this Google DeepMind course you will focus on the training process for machine learning models. You will learn how to spot and mitigate issues when training a model, such as overfitting and underfitting. In practical coding labs, you will implement and evaluate the multilayer perceptron for simple classification tasks. This will provide insights into the mechanics of training a neural network model and the backpropagation algorithm. Research case studies will demonstrate how neural networks power real-world models. Additionally, you will consider the broader social impacts of innovation by looking beyond immediate benefits to anticipate potential risks, safety concerns, and further-reaching societal consequences.
In this Google DeepMind course you will learn how to prepare text data for language models to process. You will investigate the tools and techniques used to prepare, structure, and represent text data for language models, with a focus on tokenization and embeddings. You will be encouraged to think critically about the decisions behind data preparation, and what biases within the data may be introduced into models. You will analyze trade-offs, learn how to work with vectors and matrices, how meaning is represented in language models. Finally, you will practice designing a dataset ethically using the Data Cards process, ensuring transparency, accountability, and respect for community values in AI development.
In this Google DeepMind course, you will learn the fundamentals of language models and gain a high-level understanding of the machine learning development pipeline. You will consider the strengths and limitations of traditional n-gram models and advanced transformer models. Practical coding labs will enable you to develop insights into how machine learning models work and how they can be used to generate text and identify patterns in language. Through real-world case studies, you will build an understanding around how research engineers operate. Drawing on these insights you will identify problems that you wish to tackle in your own community and consider how to leverage the power of machine learning responsibly to address these problems within a global and local context.
The course aims to train Google technical sales partners on the business value discovery process using proprietary content.
Want to learn more about Google Cloud? Grow your Google Cloud knowledge, strengthen your skills to win with customers, and scale your Google Cloud business. Find it here in one handy location.
This course enables system integrators and partners to understand the principles of automated migrations, plan legacy system migrations to Google Cloud leveraging G4 Platform, and execute a trial code conversion.
完成建立及管理 AlloyDB 執行個體技能徽章入門課程, 即可證明自己具備下列技能:執行主要 AlloyDB 作業 和工作、從 PostgreSQL 遷移至 AlloyDB、管理 AlloyDB 資料庫,以及 使用 AlloyDB 資料欄引擎加快數據分析查詢。
完成「建立及管理 Bigtable 執行個體」技能徽章入門課程,證明您具備下列技能:建立執行個體、設計結構定義、 查詢資料,以及在 Bigtable 執行管理工作,包括監控效能、設定自動調度節點資源和複製作業。
完成「建立及管理 Cloud Spanner 執行個體」技能徽章入門課程,即可證明自己具備下列技能: 建立 Cloud Spanner 執行個體和資料庫,並與其互動; 使用各種技術載入 Cloud Spanner 資料庫; 備份 Cloud Spanner 資料庫;定義結構定義及瞭解查詢計畫;以及 部署連線至 Cloud Spanner 執行個體的現代化網頁應用程式。
完成建立及管理 PostgreSQL 適用的 Cloud SQL 執行個體技能徽章入門課程,證明您具備下列技能:遷移、設定和管理 PostgreSQL 適用的 Cloud SQL 執行個體和資料庫。
本課程會介紹 Vertex AI Studio。您可以運用這項工具和生成式 AI 模型互動、根據商業構想設計原型,並投入到正式環境。透過身歷其境的應用實例、有趣的課程及實作實驗室,您將能探索從提示到正式環境的生命週期,同時學習如何將 Vertex AI Studio 運用在多模態版 Gemini 應用程式、提示設計、提示工程和模型調整。這個課程的目標是讓您能運用 Vertex AI Studio,在專案中發揮生成式 AI 的潛能。
這個入門微學習課程主要說明生成式 AI 的定義和使用方式,以及此 AI 與傳統機器學習方法的差異。本課程也會介紹各項 Google 工具,協助您開發自己的生成式 AI 應用程式。
This course introduces you to the world of reliable deep learning, a critical discipline focused on developing machine learning models that not only make accurate predictions but also understand and communicate their own uncertainty. You'll learn how to create AI systems that are trustworthy, robust, and adaptable, particularly in high-stakes scenarios where errors can have significant consequences.
完成 使用資料庫遷移服務將 MySQL 資料遷移至 Cloud SQL 技能徽章入門課程,證明您具備下列技能: 使用「資料庫遷移服務」中各種可用的工作類型和連線選項, 將 MySQL 資料遷移至 Cloud SQL,以及在執行「資料庫遷移服務」工作時 遷移 MySQL 使用者資料。
This course is intended to give architects, engineers, and developers the skills required to help enterprise customers architect, plan, execute, and test database migration projects. Through a combination of presentations, demos, and hands-on labs participants move databases to Google Cloud while taking advantage of various services. This course covers how to move on-premises, enterprise databases like SQL Server to Google Cloud (Compute Engine and Cloud SQL) and Oracle to Google Cloud bare metal.
In this course, you learn to analyze and choose the right database for your needs, to effectively develop applications on Google Cloud. You explore relational and NoSQL databases, dive into Cloud SQL, AlloyDB, and Spanner, and learn how to align database strengths with your application requirements, including those of generative AI. Gain hands-on experience configuring Vector Search and migrating applications to the cloud.
「Google Cloud 基礎知識:核心基礎架構」介紹了在使用 Google Cloud 時會遇到的重要概念和術語。本課程會透過影片和實作實驗室,介紹並比較 Google Cloud 的多種運算和儲存服務,同時提供重要的資源和政策管理工具。
This course takes a real-world approach to the ML Workflow through a case study. An ML team faces several ML business requirements and use cases. The team must understand the tools required for data management and governance and consider the best approach for data preprocessing. The team is presented with three options to build ML models for two use cases. The course explains why they would use AutoML, BigQuery ML, or custom training to achieve their objectives.
This course explores what ML is and what problems it can solve. The course also discusses best practices for implementing machine learning. You’re introduced to Vertex AI, a unified platform to quickly build, train, and deploy AutoML machine learning models. The course discusses the five phases of converting a candidate use case to be driven by machine learning, and why it’s important to not skip them. The course ends with recognizing the biases that ML can amplify and how to recognize them.
完成使用 BigQuery ML 為預測模型進行資料工程技能徽章中階課程, 即可證明自己具備下列知識與技能:運用 Dataprep by Trifacta 建構連至 BigQuery 的資料轉換 pipeline; 使用 Cloud Storage、Dataflow 和 BigQuery 建構「擷取、轉換及載入」(ETL) 工作負載, 以及使用 BigQuery ML 建構機器學習模型。
完成 透過 BigQuery 建構資料倉儲 技能徽章中階課程,即可證明您具備下列技能: 彙整資料以建立新資料表、排解彙整作業問題、利用聯集附加資料、建立依日期分區的資料表, 以及在 BigQuery 使用 JSON、陣列和結構體。
完成 在 Google Cloud 為機器學習 API 準備資料 技能徽章入門課程,即可證明您具備下列技能: 使用 Dataprep by Trifacta 清理資料、在 Dataflow 執行資料管道、在 Managed Service for Apache Spark 建立叢集和執行 Apache Spark 工作,以及呼叫機器學習 API,包含 Cloud Natural Language API、Google Cloud Speech-to-Text API 和 Video Intelligence API。
In the last installment of the Dataflow course series, we will introduce the components of the Dataflow operational model. We will examine tools and techniques for troubleshooting and optimizing pipeline performance. We will then review testing, deployment, and reliability best practices for Dataflow pipelines. We will conclude with a review of Templates, which makes it easy to scale Dataflow pipelines to organizations with hundreds of users. These lessons will help ensure that your data platform is stable and resilient to unanticipated circumstances.
In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks.
This course is part 1 of a 3-course series on Serverless Data Processing with Dataflow. In this first course, we start with a refresher of what Apache Beam is and its relationship with Dataflow. Next, we talk about the Apache Beam vision and the benefits of the Beam Portability framework. The Beam Portability framework achieves the vision that a developer can use their favorite programming language with their preferred execution backend. We then show you how Dataflow allows you to separate compute and storage while saving money, and how identity, access, and management tools interact with your Dataflow pipelines. Lastly, we look at how to implement the right security model for your use case on Dataflow.
Incorporating machine learning into data pipelines increases the ability to extract insights from data. This course covers ways machine learning can be included in data pipelines on Google Cloud. For little to no customization, this course covers AutoML. For more tailored machine learning capabilities, this course introduces Notebooks and BigQuery machine learning (BigQuery ML). Also, this course covers how to productionalize machine learning solutions by using Vertex AI.
In this intermediate course, you will learn to design, build, and optimize robust batch data pipelines on Google Cloud. Moving beyond fundamental data handling, you will explore large-scale data transformations and efficient workflow orchestration, essential for timely business intelligence and critical reporting. Get hands-on practice using Dataflow for Apache Beam and Serverless for Apache Spark (Dataproc Serverless) for implementation, and tackle crucial considerations for data quality, monitoring, and alerting to ensure pipeline reliability and operational excellence. A basic knowledge of data warehousing, ETL/ELT, SQL, Python, and Google Cloud concepts is recommended.
In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.
While the traditional approaches of using data lakes and data warehouses can be effective, they have shortcomings, particularly in large enterprise environments. This course introduces the concept of a data lakehouse and the Google Cloud products used to create one. A lakehouse architecture uses open-standard data sources and combines the best features of data lakes and data warehouses, which addresses many of their shortcomings.
This course introduces the Google Cloud big data and machine learning products and services that support the data-to-AI lifecycle. It explores the processes, challenges, and benefits of building a big data pipeline and machine learning models with Vertex AI on Google Cloud.
This course helps learners create a study plan for the PDE (Professional Data Engineer) certification exam. Learners explore the breadth and scope of the domains covered in the exam. Learners assess their exam readiness and create their individual study plan.