Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Ilya S. · Reviewed about 1 month ago

Ayan B. · Reviewed about 1 month ago

Dennis C. · Reviewed about 1 month ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed about 1 month ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed about 1 month ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed about 1 month ago

Armando B. · Reviewed about 1 month ago

Pedro A. · Reviewed about 1 month ago

not up to date

Nikola P. · Reviewed about 1 month ago

Bronislav S. · Reviewed about 1 month ago

Dominika K. · Reviewed about 1 month ago

Ayesha M. · Reviewed about 1 month ago

Rushab B. · Reviewed about 1 month ago

Sonika Sharma S. · Reviewed about 1 month ago

No indication if i completed lab

Eugene K. · Reviewed about 1 month ago

Some instructions were outdated (didn't match with UI when following instructions)

Hugo N. · Reviewed about 1 month ago

Allen Chen 陳政安 E. · Reviewed about 1 month ago

Mukund K. · Reviewed about 1 month ago

Sigala M. · Reviewed about 1 month ago

Jaime L. · Reviewed about 1 month ago

스윗 레. · Reviewed about 1 month ago

Paula V. · Reviewed about 1 month ago

Vikas G. · Reviewed about 1 month ago

Sebastian S. · Reviewed about 1 month ago

Luis Alvaro M. · Reviewed about 1 month ago