Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Ilya S. · Reviewed בערך חודש אחד ago

Ayan B. · Reviewed בערך חודש אחד ago

Dennis C. · Reviewed בערך חודש אחד ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed בערך חודש אחד ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed בערך חודש אחד ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed בערך חודש אחד ago

Armando B. · Reviewed בערך חודש אחד ago

Pedro A. · Reviewed בערך חודש אחד ago

not up to date

Nikola P. · Reviewed בערך חודש אחד ago

Bronislav S. · Reviewed בערך חודש אחד ago

Dominika K. · Reviewed בערך חודש אחד ago

Ayesha M. · Reviewed בערך חודש אחד ago

Rushab B. · Reviewed בערך חודש אחד ago

Sonika Sharma S. · Reviewed בערך חודש אחד ago

No indication if i completed lab

Eugene K. · Reviewed בערך חודש אחד ago

Some instructions were outdated (didn't match with UI when following instructions)

Hugo N. · Reviewed בערך חודש אחד ago

Allen Chen 陳政安 E. · Reviewed בערך חודש אחד ago

Mukund K. · Reviewed בערך חודש אחד ago

Sigala M. · Reviewed בערך חודש אחד ago

Jaime L. · Reviewed בערך חודש אחד ago

스윗 레. · Reviewed בערך חודש אחד ago

Paula V. · Reviewed בערך חודש אחד ago

Vikas G. · Reviewed בערך חודש אחד ago

Sebastian S. · Reviewed בערך חודש אחד ago

Luis Alvaro M. · Reviewed בערך חודש אחד ago