ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

I had to add the following permissions on compute engine service account for this to work: Dataflow Admin Cloud Dataflow Service Agent Editor

Sarma P. · Reviewed מעל 5 שנים ago

Fabián C. · Reviewed מעל 5 שנים ago

Abhinay V. · Reviewed מעל 5 שנים ago

Devansh S. · Reviewed מעל 5 שנים ago

Pallabi M. · Reviewed מעל 5 שנים ago

yasunori s. · Reviewed מעל 5 שנים ago

Ankita S. · Reviewed מעל 5 שנים ago

Madhi v. · Reviewed מעל 5 שנים ago

Piyush K. · Reviewed מעל 5 שנים ago

CLI not connected

gopi g. · Reviewed מעל 5 שנים ago

Madhi v. · Reviewed מעל 5 שנים ago

NA

Vishal K. · Reviewed מעל 5 שנים ago

Vijayaragavan K. · Reviewed מעל 5 שנים ago

Pawan K. · Reviewed מעל 5 שנים ago

Chaitanya M. · Reviewed מעל 5 שנים ago

kavya p. · Reviewed מעל 5 שנים ago

wasn't able to finnish because i received this error File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute()

Sergio B. · Reviewed מעל 5 שנים ago

Satyam G. · Reviewed מעל 5 שנים ago

Adisak S. · Reviewed מעל 5 שנים ago

Tetsuki T. · Reviewed מעל 5 שנים ago

Kiril Y. · Reviewed מעל 5 שנים ago

Awesome

Ramkrishna A. · Reviewed מעל 5 שנים ago

This is the worst lab I have taken so far here on qwiklabs, and to think the topic was supposed to be the most familiar to me. After going through the lab I actually feel more lost, even though I've been doing ETL the last 15 years (though not on cloud until ~2 years ago). Even though I also use Cloud Shell/gsutil/etc whenever possible when working, I wish in learning mediums such as this, the lab used more visual approach. The lab just says "here's code, understand on your own then run it. You have one hour." Even creating a bucket or a dataset would have been much simpler and informative if we did it via UI, instead of being given the complete code for us to just copy paste. TL;DR more UI steps, less Cloud Shell Finally, even if I preferred the codes over the UI, the 1-hour time limit is a bit tight, especially since Dataflow takes its time starting up.

Jan A. · Reviewed מעל 5 שנים ago

very good

Frederick A. · Reviewed מעל 5 שנים ago

Axel Z. · Reviewed מעל 5 שנים ago