ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

Joshua W. · Reviewed כמעט 7 שנים ago

Kunal L. · Reviewed כמעט 7 שנים ago

Joshua W. · Reviewed כמעט 7 שנים ago

Steve T. · Reviewed כמעט 7 שנים ago

Bernd S. · Reviewed כמעט 7 שנים ago

Michael I. · Reviewed כמעט 7 שנים ago

Mark C. · Reviewed כמעט 7 שנים ago

Alexandre M. · Reviewed כמעט 7 שנים ago

shit lab. full of bugs. did it 3 times and cant ever complete. slow spinning up and down of workers. atrocious. and such limited time. and there is issue recognising tasks i have already completed.

Decki K. · Reviewed כמעט 7 שנים ago

Oren L. · Reviewed כמעט 7 שנים ago

Ekta R. · Reviewed כמעט 7 שנים ago

Richard C. · Reviewed כמעט 7 שנים ago

Google Cloud Shell not working.

Narendra Babu O. · Reviewed כמעט 7 שנים ago

嘉瑋 姚. · Reviewed כמעט 7 שנים ago

good

Pooja T. · Reviewed כמעט 7 שנים ago

Xiangyang S. · Reviewed כמעט 7 שנים ago

Muhammad F. · Reviewed כמעט 7 שנים ago

This lab throws around terminology via the python script names like transformation, enrichment, and mart, but really things like transformation and enrichment would be separate steps from ingestion and not combined into one step. Also, some of the documentation in the lab is erroneous. For example in Step 6, it says in the step you will "Ingest the files from GCS" but that is not true -- Steps 6 uses data only from BigQuery and not from GCS. Furthermore, when you look at the resulting data from the last step, the process has replaced things like City with the customer name, so the example code is flawed. Finally, there is no architecture or data flow diagram -- no visual representation of what is going on; and also no mention of what Apache Beam is and how it relates to DataFlow. Finally, ETL is an outdated legacy term. Big Data uses other concepts and follows a different model than ETL.

Luther M. · Reviewed כמעט 7 שנים ago

Lab worked but some of the steps take an incredible amount of time if you sit and wait for them to complete on the CLI. Also "read the code" isn't a great explanation of each step. Each step feels like it was simply cut/pasted 5 times.

Jamal M. · Reviewed כמעט 7 שנים ago

Benjamin R. · Reviewed כמעט 7 שנים ago

Debanjan D. · Reviewed כמעט 7 שנים ago

Balaji C. · Reviewed כמעט 7 שנים ago

Matthew W. · Reviewed כמעט 7 שנים ago

Anil Sagar R. · Reviewed כמעט 7 שנים ago

Rendson F. · Reviewed כמעט 7 שנים ago