Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Daniela C. · Reviewed أكثر من سنة ago

Just an opinion. I think in the following command (Task 5) the last line should not have the "timestamp" field, just the "minute" field. WITH streaming_data AS ( SELECT timestamp, TIMESTAMP_TRUNC(timestamp, HOUR, 'UTC') AS hour, TIMESTAMP_TRUNC(timestamp, MINUTE, 'UTC') AS minute, TIMESTAMP_TRUNC(timestamp, SECOND, 'UTC') AS second, ride_id, latitude, longitude, meter_reading, ride_status, passenger_count FROM taxirides.realtime ORDER BY timestamp DESC LIMIT 1000 ) # calculate aggregations on stream for reporting: SELECT ROW_NUMBER() OVER() AS dashboard_sort, minute, COUNT(DISTINCT ride_id) AS total_rides, SUM(meter_reading) AS total_revenue, SUM(passenger_count) AS total_passengers FROM streaming_data GROUP BY minute, timestamp

Igor A. · Reviewed أكثر من سنة ago

JESUS ANTONIO C. · Reviewed أكثر من سنة ago

Uriel F. · Reviewed أكثر من سنة ago

Siddhant D. · Reviewed أكثر من سنة ago

ALLAN F. · Reviewed أكثر من سنة ago

I bit confuse uding the setup panel on looker studio

Raziel M. · Reviewed أكثر من سنة ago

The instructions to fill in the Dataflow details were out of order and confusing. And I spend more time waiting for the Dataflow job to run than I did actually working.

Ben S. · Reviewed أكثر من سنة ago

Fiorella Y. · Reviewed أكثر من سنة ago

Frederik Adolfo S. · Reviewed أكثر من سنة ago

Renatha Amelia M. · Reviewed أكثر من سنة ago

John R. · Reviewed أكثر من سنة ago

Brenno N. · Reviewed أكثر من سنة ago

Roberto P. · Reviewed أكثر من سنة ago

Ana P. · Reviewed أكثر من سنة ago

Great!

Emerson C. · Reviewed أكثر من سنة ago

Alan D. · Reviewed أكثر من سنة ago

Afridha B. · Reviewed أكثر من سنة ago

Thiago P. · Reviewed أكثر من سنة ago

It was really clear! I thought that the Dataflow would end but then realized it was an "on going" or "live" job

Alberto A. · Reviewed أكثر من سنة ago

Ayman S. · Reviewed أكثر من سنة ago

Ernesto Rodolfo C. · Reviewed أكثر من سنة ago

Arrijalul K. · Reviewed أكثر من سنة ago

Rohit D. · Reviewed أكثر من سنة ago

Rizki R. · Reviewed أكثر من سنة ago