Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Dayanand B. · Reviewed 1 saat ago

Fernando H. · Reviewed 3 saat ago

some steps did not work

Shivakeerthi K. · Reviewed 6 saat ago

G CHETHAN A. · Reviewed 9 saat ago

Vaishnavi M. · Reviewed 10 saat ago

Scott D. · Reviewed 11 saat ago

KAVITA R. · Reviewed 11 saat ago

Sanjivani M. · Reviewed 13 saat ago

Euphemia Z. · Reviewed 13 saat ago

Lebogang M. · Reviewed 14 saat ago

Prajwal P. · Reviewed 17 saat ago

Vedant M. · Reviewed 18 saat ago

Looker is not very intuitive and hard to navigate based on lab instructions

Tim S. · Reviewed 19 saat ago

Somya P. · Reviewed 19 saat ago

Ilya S. · Reviewed 1 gün ago

Ayan B. · Reviewed 1 gün ago

Dennis C. · Reviewed 1 gün ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed 1 gün ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed 1 gün ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed 1 gün ago

Armando B. · Reviewed 1 gün ago

Pedro A. · Reviewed 1 gün ago

not up to date

Nikola P. · Reviewed 1 gün ago

Bronislav S. · Reviewed 1 gün ago

Dominika K. · Reviewed 1 gün ago