Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Ilya S. · Reviewed حوالي شهر واحد ago

Ayan B. · Reviewed حوالي شهر واحد ago

Dennis C. · Reviewed حوالي شهر واحد ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed حوالي شهر واحد ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed حوالي شهر واحد ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed حوالي شهر واحد ago

Armando B. · Reviewed حوالي شهر واحد ago

Pedro A. · Reviewed حوالي شهر واحد ago

not up to date

Nikola P. · Reviewed حوالي شهر واحد ago

Bronislav S. · Reviewed حوالي شهر واحد ago

Dominika K. · Reviewed حوالي شهر واحد ago

Ayesha M. · Reviewed حوالي شهر واحد ago

Rushab B. · Reviewed حوالي شهر واحد ago

Sonika Sharma S. · Reviewed حوالي شهر واحد ago

No indication if i completed lab

Eugene K. · Reviewed حوالي شهر واحد ago

Some instructions were outdated (didn't match with UI when following instructions)

Hugo N. · Reviewed حوالي شهر واحد ago

Allen Chen 陳政安 E. · Reviewed حوالي شهر واحد ago

Mukund K. · Reviewed حوالي شهر واحد ago

Sigala M. · Reviewed حوالي شهر واحد ago

Jaime L. · Reviewed حوالي شهر واحد ago

스윗 레. · Reviewed حوالي شهر واحد ago

Paula V. · Reviewed حوالي شهر واحد ago

Vikas G. · Reviewed حوالي شهر واحد ago

Sebastian S. · Reviewed حوالي شهر واحد ago

Luis Alvaro M. · Reviewed حوالي شهر واحد ago