Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Somya P. · Reviewed about 2 months ago

Ilya S. · Reviewed about 2 months ago

Ayan B. · Reviewed about 2 months ago

Dennis C. · Reviewed about 2 months ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed about 2 months ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed about 2 months ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed about 2 months ago

Armando B. · Reviewed about 2 months ago

Pedro A. · Reviewed about 2 months ago

not up to date

Nikola P. · Reviewed about 2 months ago

Bronislav S. · Reviewed about 2 months ago

Dominika K. · Reviewed about 2 months ago

Ayesha M. · Reviewed about 2 months ago

Rushab B. · Reviewed about 2 months ago

Sonika Sharma S. · Reviewed about 2 months ago

No indication if i completed lab

Eugene K. · Reviewed about 2 months ago

Some instructions were outdated (didn't match with UI when following instructions)

Hugo N. · Reviewed about 2 months ago

Allen Chen 陳政安 E. · Reviewed about 2 months ago

Mukund K. · Reviewed about 2 months ago

Sigala M. · Reviewed about 2 months ago

Jaime L. · Reviewed about 2 months ago

스윗 레. · Reviewed about 2 months ago

Paula V. · Reviewed about 2 months ago

Vikas G. · Reviewed about 2 months ago

Sebastian S. · Reviewed about 2 months ago