Como criar um pipeline de dados de streaming para um painel em tempo real com o Dataflow avaliações

Daniela C. · Revisado há over 1 year

Just an opinion. I think in the following command (Task 5) the last line should not have the "timestamp" field, just the "minute" field. WITH streaming_data AS ( SELECT timestamp, TIMESTAMP_TRUNC(timestamp, HOUR, 'UTC') AS hour, TIMESTAMP_TRUNC(timestamp, MINUTE, 'UTC') AS minute, TIMESTAMP_TRUNC(timestamp, SECOND, 'UTC') AS second, ride_id, latitude, longitude, meter_reading, ride_status, passenger_count FROM taxirides.realtime ORDER BY timestamp DESC LIMIT 1000 ) # calculate aggregations on stream for reporting: SELECT ROW_NUMBER() OVER() AS dashboard_sort, minute, COUNT(DISTINCT ride_id) AS total_rides, SUM(meter_reading) AS total_revenue, SUM(passenger_count) AS total_passengers FROM streaming_data GROUP BY minute, timestamp

Igor A. · Revisado há over 1 year

JESUS ANTONIO C. · Revisado há over 1 year

Uriel F. · Revisado há over 1 year

Siddhant D. · Revisado há over 1 year

ALLAN F. · Revisado há over 1 year

I bit confuse uding the setup panel on looker studio

Raziel M. · Revisado há over 1 year

The instructions to fill in the Dataflow details were out of order and confusing. And I spend more time waiting for the Dataflow job to run than I did actually working.

Ben S. · Revisado há over 1 year

Fiorella Y. · Revisado há over 1 year

Frederik Adolfo S. · Revisado há over 1 year

Renatha Amelia M. · Revisado há over 1 year

John R. · Revisado há over 1 year

Brenno N. · Revisado há over 1 year

Roberto P. · Revisado há over 1 year

Ana P. · Revisado há over 1 year

Great!

Emerson C. · Revisado há over 1 year

Alan D. · Revisado há over 1 year

Afridha B. · Revisado há over 1 year

Thiago P. · Revisado há over 1 year

It was really clear! I thought that the Dataflow would end but then realized it was an "on going" or "live" job

Alberto A. · Revisado há over 1 year

Ayman S. · Revisado há over 1 year

Ernesto Rodolfo C. · Revisado há over 1 year

Arrijalul K. · Revisado há over 1 year

Rohit D. · Revisado há over 1 year

Rizki R. · Revisado há over 1 year