Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

I have followed the lab instructions to the letter at least 5 time and there is no data flowing. On my last attempt when I look at the pub/sub topic there are no messages. Even manually seeking back in time no messages can be found, as a result the lab cannot be completed. I would recommend whoever wrote the lab review the steps and follow the instructions in order to determine what is not longer up to date and then correct.

Glenn K. · Reviewed about 3 years ago

Datastream didn't work

Daniela T. · Reviewed about 3 years ago

Tanner S. · Reviewed about 3 years ago

horacio l. · Reviewed about 3 years ago

Raman G. · Reviewed about 3 years ago

Marco J. · Reviewed about 3 years ago

Henrik Z. · Reviewed about 3 years ago

Alexis G. · Reviewed about 3 years ago

chaitanya n. · Reviewed about 3 years ago

Henrik Z. · Reviewed about 3 years ago

Pranav R. · Reviewed about 3 years ago

Lab is completely broken: The pub/sub topic within the linked account had no messages in it, and is not receiving messages, resulting in no data. Update: Second attempt at running this lab and the same result. Additionally, I spent a half hour of the lab time trying to find the original dataset so I could at least publish a few messages to the pub/sub topic and get data somewhat in line with what is expected, but couldn't find the right dataset. Tried again over the weekend - Still broken. I've used the screenshots from this tutorial to reconstruct the example data schema enough to write a python script to generate random data in order to proceed, but had to run the lab a FOURTH time to get to that point. Nevermind - I never got this working. The amount of data needed to make this exercise work is not possible through the cloud console, and while I started exploring configuring a script with a service account and publishing to the topic that way, it just did not seem worth the risk of getting blocked from future labs. Tried this yet again - Found the original pub/sub topic from which the pub/sub included in the project is sourced, and using that topic works.

Neil P. · Reviewed about 3 years ago

Dataflow job seems to be working, but no data reaches BigQuery, waited for 15 minutes, and created 3 different jobs one after another

Elizaveta B. · Reviewed about 3 years ago

Followed instructions but data was not succesfully streamed to bigquery

GABRIELIUS K. · Reviewed about 3 years ago

Jerry Jack T. · Reviewed about 3 years ago

Maria D. · Reviewed about 3 years ago

Jerry Jack T. · Reviewed about 3 years ago

The pub/sub topic was not sending out any streaming taxi data

Satish Kumar G. · Reviewed about 3 years ago

Kaique R. · Reviewed about 3 years ago

Informative lab, however, the data never loaded into BigQuery, and I wasn't able to find the problem

Nicolás E. · Reviewed about 3 years ago

Denys S. · Reviewed about 3 years ago

dataflow returned no data from pubsub topic, even after 20 mins.

Stephen O. · Reviewed about 3 years ago

Undavalli J. · Reviewed about 3 years ago

Saniya m. · Reviewed about 3 years ago

The streaming job didn't work and I didn't know how to fix it.

Christopher H. · Reviewed about 3 years ago