Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow avis

Daniela C. · Examiné il y a plus d'un an

Just an opinion. I think in the following command (Task 5) the last line should not have the "timestamp" field, just the "minute" field. WITH streaming_data AS ( SELECT timestamp, TIMESTAMP_TRUNC(timestamp, HOUR, 'UTC') AS hour, TIMESTAMP_TRUNC(timestamp, MINUTE, 'UTC') AS minute, TIMESTAMP_TRUNC(timestamp, SECOND, 'UTC') AS second, ride_id, latitude, longitude, meter_reading, ride_status, passenger_count FROM taxirides.realtime ORDER BY timestamp DESC LIMIT 1000 ) # calculate aggregations on stream for reporting: SELECT ROW_NUMBER() OVER() AS dashboard_sort, minute, COUNT(DISTINCT ride_id) AS total_rides, SUM(meter_reading) AS total_revenue, SUM(passenger_count) AS total_passengers FROM streaming_data GROUP BY minute, timestamp

Igor A. · Examiné il y a plus d'un an

JESUS ANTONIO C. · Examiné il y a plus d'un an

Uriel F. · Examiné il y a plus d'un an

Siddhant D. · Examiné il y a plus d'un an

ALLAN F. · Examiné il y a plus d'un an

I bit confuse uding the setup panel on looker studio

Raziel M. · Examiné il y a plus d'un an

The instructions to fill in the Dataflow details were out of order and confusing. And I spend more time waiting for the Dataflow job to run than I did actually working.

Ben S. · Examiné il y a plus d'un an

Fiorella Y. · Examiné il y a plus d'un an

Frederik Adolfo S. · Examiné il y a plus d'un an

Renatha Amelia M. · Examiné il y a plus d'un an

John R. · Examiné il y a plus d'un an

Brenno N. · Examiné il y a plus d'un an

Roberto P. · Examiné il y a plus d'un an

Ana P. · Examiné il y a plus d'un an

Great!

Emerson C. · Examiné il y a plus d'un an

Alan D. · Examiné il y a plus d'un an

Afridha B. · Examiné il y a plus d'un an

Thiago P. · Examiné il y a plus d'un an

It was really clear! I thought that the Dataflow would end but then realized it was an "on going" or "live" job

Alberto A. · Examiné il y a plus d'un an

Ayman S. · Examiné il y a plus d'un an

Ernesto Rodolfo C. · Examiné il y a plus d'un an

Arrijalul K. · Examiné il y a plus d'un an

Rohit D. · Examiné il y a plus d'un an

Rizki R. · Examiné il y a plus d'un an