Opinie (ETL Processing on Google Cloud Using Dataflow and BigQuery (Python))

I had to add the following permissions on compute engine service account for this to work: Dataflow Admin Cloud Dataflow Service Agent Editor

Sarma P. · Sprawdzono ponad 5 lat temu

Fabián C. · Sprawdzono ponad 5 lat temu

Abhinay V. · Sprawdzono ponad 5 lat temu

Devansh S. · Sprawdzono ponad 5 lat temu

Pallabi M. · Sprawdzono ponad 5 lat temu

yasunori s. · Sprawdzono ponad 5 lat temu

Ankita S. · Sprawdzono ponad 5 lat temu

Madhi v. · Sprawdzono ponad 5 lat temu

Piyush K. · Sprawdzono ponad 5 lat temu

CLI not connected

gopi g. · Sprawdzono ponad 5 lat temu

Madhi v. · Sprawdzono ponad 5 lat temu

NA

Vishal K. · Sprawdzono ponad 5 lat temu

Vijayaragavan K. · Sprawdzono ponad 5 lat temu

Pawan K. · Sprawdzono ponad 5 lat temu

Chaitanya M. · Sprawdzono ponad 5 lat temu

kavya p. · Sprawdzono ponad 5 lat temu

wasn't able to finnish because i received this error File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute()

Sergio B. · Sprawdzono ponad 5 lat temu

Satyam G. · Sprawdzono ponad 5 lat temu

Adisak S. · Sprawdzono ponad 5 lat temu

Tetsuki T. · Sprawdzono ponad 5 lat temu

Kiril Y. · Sprawdzono ponad 5 lat temu

Awesome

Ramkrishna A. · Sprawdzono ponad 5 lat temu

This is the worst lab I have taken so far here on qwiklabs, and to think the topic was supposed to be the most familiar to me. After going through the lab I actually feel more lost, even though I've been doing ETL the last 15 years (though not on cloud until ~2 years ago). Even though I also use Cloud Shell/gsutil/etc whenever possible when working, I wish in learning mediums such as this, the lab used more visual approach. The lab just says "here's code, understand on your own then run it. You have one hour." Even creating a bucket or a dataset would have been much simpler and informative if we did it via UI, instead of being given the complete code for us to just copy paste. TL;DR more UI steps, less Cloud Shell Finally, even if I preferred the codes over the UI, the 1-hour time limit is a bit tight, especially since Dataflow takes its time starting up.

Jan A. · Sprawdzono ponad 5 lat temu

very good

Frederick A. · Sprawdzono ponad 5 lat temu

Axel Z. · Sprawdzono ponad 5 lat temu