Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

G CHETHAN A. · Reviewed בערך 2 שעות ago

Vaishnavi M. · Reviewed בערך 3 שעות ago

Scott D. · Reviewed בערך 3 שעות ago

KAVITA R. · Reviewed בערך 3 שעות ago

Sanjivani M. · Reviewed בערך 6 שעות ago

Euphemia Z. · Reviewed בערך 6 שעות ago

Lebogang M. · Reviewed בערך 6 שעות ago

Prajwal P. · Reviewed בערך 9 שעות ago

Vedant M. · Reviewed בערך 11 שעות ago

Looker is not very intuitive and hard to navigate based on lab instructions

Tim S. · Reviewed בערך 11 שעות ago

Somya P. · Reviewed בערך 12 שעות ago

Ilya S. · Reviewed בערך 22 שעות ago

Ayan B. · Reviewed בערך 23 שעות ago

Dennis C. · Reviewed בערך 24 שעות ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed יום אחד ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed יום אחד ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed יום אחד ago

Armando B. · Reviewed יום אחד ago

Pedro A. · Reviewed יום אחד ago

not up to date

Nikola P. · Reviewed יום אחד ago

Bronislav S. · Reviewed יום אחד ago

Dominika K. · Reviewed יום אחד ago

Ayesha M. · Reviewed יום אחד ago

Rushab B. · Reviewed יום אחד ago

Sonika Sharma S. · Reviewed יום אחד ago