Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Akash K. · Reviewed 7 חודשים ago

Dayanand B. · Reviewed 7 חודשים ago

Fernando H. · Reviewed 7 חודשים ago

some steps did not work

Shivakeerthi K. · Reviewed 7 חודשים ago

G CHETHAN A. · Reviewed 7 חודשים ago

Vaishnavi M. · Reviewed 7 חודשים ago

Scott D. · Reviewed 7 חודשים ago

KAVITA R. · Reviewed 7 חודשים ago

Sanjivani M. · Reviewed 7 חודשים ago

Euphemia Z. · Reviewed 7 חודשים ago

Lebogang M. · Reviewed 7 חודשים ago

Prajwal P. · Reviewed 7 חודשים ago

Vedant M. · Reviewed 7 חודשים ago

Looker is not very intuitive and hard to navigate based on lab instructions

Tim S. · Reviewed 7 חודשים ago

Somya P. · Reviewed 7 חודשים ago

Ilya S. · Reviewed 7 חודשים ago

Ayan B. · Reviewed 7 חודשים ago

Dennis C. · Reviewed 7 חודשים ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed 7 חודשים ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed 7 חודשים ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed 7 חודשים ago

Armando B. · Reviewed 7 חודשים ago

Pedro A. · Reviewed 7 חודשים ago

not up to date

Nikola P. · Reviewed 7 חודשים ago

Bronislav S. · Reviewed 7 חודשים ago