Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow avis

Akash S. · Examiné il y a 3 jours

Akash K. · Examiné il y a 3 jours

Dayanand B. · Examiné il y a 3 jours

Fernando H. · Examiné il y a 3 jours

some steps did not work

Shivakeerthi K. · Examiné il y a 3 jours

G CHETHAN A. · Examiné il y a 3 jours

Vaishnavi M. · Examiné il y a 3 jours

Scott D. · Examiné il y a 3 jours

KAVITA R. · Examiné il y a 3 jours

Sanjivani M. · Examiné il y a 3 jours

Euphemia Z. · Examiné il y a 3 jours

Lebogang M. · Examiné il y a 3 jours

Prajwal P. · Examiné il y a 3 jours

Vedant M. · Examiné il y a 3 jours

Looker is not very intuitive and hard to navigate based on lab instructions

Tim S. · Examiné il y a 4 jours

Somya P. · Examiné il y a 4 jours

Ilya S. · Examiné il y a 4 jours

Ayan B. · Examiné il y a 4 jours

Dennis C. · Examiné il y a 4 jours

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Examiné il y a 4 jours

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Examiné il y a 4 jours

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Examiné il y a 4 jours

Armando B. · Examiné il y a 4 jours

Pedro A. · Examiné il y a 4 jours

not up to date

Nikola P. · Examiné il y a 4 jours