Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Diagrams of areas and selections items would be very helpful and expected from a professional organization.

Don M. · Reviewed over 3 years ago

Md Irfan A. · Reviewed over 3 years ago

I could not follow all the instructions, maybe my fault.

Serhan K. · Reviewed over 3 years ago

very good

Abhijit G. · Reviewed over 3 years ago

a good lab to get hands on experience

Mike D. · Reviewed over 3 years ago

MOIDUDDIN A. · Reviewed over 3 years ago

Mike D. · Reviewed over 3 years ago

Manuel Jose C. · Reviewed over 3 years ago

Streamline pipeline job not streaming data, Tried twice

Vishal K. · Reviewed over 3 years ago

short time

Dalia H. · Reviewed over 3 years ago

outdated, UI and process have changed significantly, unable to complete all parts of lab

Jeffrey K. · Reviewed over 3 years ago

Achraf I. · Reviewed over 3 years ago

Jordi L. · Reviewed over 3 years ago

Lack of screenshots

MARTIAL K. · Reviewed over 3 years ago

Nicolas B. · Reviewed over 3 years ago

Pierre-Arnaud B. · Reviewed over 3 years ago

Oleh V. · Reviewed over 3 years ago

Jay P. · Reviewed over 3 years ago

Zuhaib Muhammad -. · Reviewed over 3 years ago

V G. · Reviewed over 3 years ago

Gaurav J. · Reviewed over 3 years ago

I suspect there is an error in this query: WITH streaming_data AS ( SELECT timestamp, TIMESTAMP_TRUNC(timestamp, HOUR, 'UTC') AS hour, TIMESTAMP_TRUNC(timestamp, MINUTE, 'UTC') AS minute, TIMESTAMP_TRUNC(timestamp, SECOND, 'UTC') AS second, ride_id, latitude, longitude, meter_reading, ride_status, passenger_count FROM taxirides.realtime ORDER BY timestamp DESC LIMIT 1000 ) # calculate aggregations on stream for reporting: SELECT ROW_NUMBER() OVER() AS dashboard_sort, minute, COUNT(DISTINCT ride_id) AS total_rides, SUM(meter_reading) AS total_revenue, SUM(passenger_count) AS total_passengers FROM streaming_data GROUP BY minute, timestamp The text says that the result shows key metrics by the minute for every taxi drop-off. However, by grouping per timestamp and minute, you are doing a data-summary by row and not by minute. Finally, 2 minutes were not enough to collect drop-off data to create the final plot, at least in my case. Cheers, Giacomo

Giacomo B. · Reviewed over 3 years ago

Shruti K. · Reviewed over 3 years ago

anuj g. · Reviewed over 3 years ago

Alodeepa R. · Reviewed over 3 years ago