ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

I had to add the following permissions on compute engine service account for this to work: Dataflow Admin Cloud Dataflow Service Agent Editor

Sarma P. · Reviewed 5 yıldan fazla ago

Fabián C. · Reviewed 5 yıldan fazla ago

Abhinay V. · Reviewed 5 yıldan fazla ago

Devansh S. · Reviewed 5 yıldan fazla ago

Pallabi M. · Reviewed 5 yıldan fazla ago

yasunori s. · Reviewed 5 yıldan fazla ago

Ankita S. · Reviewed 5 yıldan fazla ago

Madhi v. · Reviewed 5 yıldan fazla ago

Piyush K. · Reviewed 5 yıldan fazla ago

CLI not connected

gopi g. · Reviewed 5 yıldan fazla ago

Madhi v. · Reviewed 5 yıldan fazla ago

NA

Vishal K. · Reviewed 5 yıldan fazla ago

Vijayaragavan K. · Reviewed 5 yıldan fazla ago

Pawan K. · Reviewed 5 yıldan fazla ago

Chaitanya M. · Reviewed 5 yıldan fazla ago

kavya p. · Reviewed 5 yıldan fazla ago

wasn't able to finnish because i received this error File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute()

Sergio B. · Reviewed 5 yıldan fazla ago

Satyam G. · Reviewed 5 yıldan fazla ago

Adisak S. · Reviewed 5 yıldan fazla ago

Tetsuki T. · Reviewed 5 yıldan fazla ago

Kiril Y. · Reviewed 5 yıldan fazla ago

Awesome

Ramkrishna A. · Reviewed 5 yıldan fazla ago

This is the worst lab I have taken so far here on qwiklabs, and to think the topic was supposed to be the most familiar to me. After going through the lab I actually feel more lost, even though I've been doing ETL the last 15 years (though not on cloud until ~2 years ago). Even though I also use Cloud Shell/gsutil/etc whenever possible when working, I wish in learning mediums such as this, the lab used more visual approach. The lab just says "here's code, understand on your own then run it. You have one hour." Even creating a bucket or a dataset would have been much simpler and informative if we did it via UI, instead of being given the complete code for us to just copy paste. TL;DR more UI steps, less Cloud Shell Finally, even if I preferred the codes over the UI, the 1-hour time limit is a bit tight, especially since Dataflow takes its time starting up.

Jan A. · Reviewed 5 yıldan fazla ago

very good

Frederick A. · Reviewed 5 yıldan fazla ago

Axel Z. · Reviewed 5 yıldan fazla ago