ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

I had to add the following permissions on compute engine service account for this to work: Dataflow Admin Cloud Dataflow Service Agent Editor

Sarma P. · Reviewed over 5 years ago

Fabián C. · Reviewed over 5 years ago

Abhinay V. · Reviewed over 5 years ago

Devansh S. · Reviewed over 5 years ago

Pallabi M. · Reviewed over 5 years ago

yasunori s. · Reviewed over 5 years ago

Ankita S. · Reviewed over 5 years ago

Madhi v. · Reviewed over 5 years ago

Piyush K. · Reviewed over 5 years ago

CLI not connected

gopi g. · Reviewed over 5 years ago

Madhi v. · Reviewed over 5 years ago

NA

Vishal K. · Reviewed over 5 years ago

Vijayaragavan K. · Reviewed over 5 years ago

Pawan K. · Reviewed over 5 years ago

Chaitanya M. · Reviewed over 5 years ago

kavya p. · Reviewed over 5 years ago

wasn't able to finnish because i received this error File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute()

Sergio B. · Reviewed over 5 years ago

Satyam G. · Reviewed over 5 years ago

Adisak S. · Reviewed over 5 years ago

Tetsuki T. · Reviewed over 5 years ago

Kiril Y. · Reviewed over 5 years ago

Awesome

Ramkrishna A. · Reviewed over 5 years ago

This is the worst lab I have taken so far here on qwiklabs, and to think the topic was supposed to be the most familiar to me. After going through the lab I actually feel more lost, even though I've been doing ETL the last 15 years (though not on cloud until ~2 years ago). Even though I also use Cloud Shell/gsutil/etc whenever possible when working, I wish in learning mediums such as this, the lab used more visual approach. The lab just says "here's code, understand on your own then run it. You have one hour." Even creating a bucket or a dataset would have been much simpler and informative if we did it via UI, instead of being given the complete code for us to just copy paste. TL;DR more UI steps, less Cloud Shell Finally, even if I preferred the codes over the UI, the 1-hour time limit is a bit tight, especially since Dataflow takes its time starting up.

Jan A. · Reviewed over 5 years ago

very good

Frederick A. · Reviewed over 5 years ago

Axel Z. · Reviewed over 5 years ago