ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

got access denied error when trying to copy csv files from python-dataflow-example bucket

David S. · Reviewed over 6 years ago

Lot of mistakes on the lab difficult to figure out things

Juby J. · Reviewed over 6 years ago

gs://spls/gsp290/usa_names.csv does not exist

Herman M. · Reviewed over 6 years ago

Arnaldo B. · Reviewed over 6 years ago

Not satisfied. This lab is garbage. All commands and code are wrong missing regional args and do not correspond to instructions. Files located in incorrect bucket locations. This was a waste fo time and credits. Garbage.

Gray L. · Reviewed over 6 years ago

error with copying into bucket storage

Jessica Y. · Reviewed over 6 years ago

not able to complete it

Kashish S. · Reviewed over 6 years ago

good

aanand k. · Reviewed over 6 years ago

Yogita V. · Reviewed over 6 years ago

Some steps are outdated (couldn´t find usa_names.csv). Also when I trid some "apache beam pipeline" steps, my machine never stopped processing, therefore I couldn´t finish the lab :c.

Dante -. · Reviewed over 6 years ago

data_transformation.py looks almost empty!!

KOJI I. · Reviewed over 6 years ago

Antonio B. · Reviewed over 6 years ago

Command provided not matching. No direction for troubleshooting

Mohammad Kamar U. · Reviewed over 6 years ago

$ gsutil cp gs://spls/gsp290/data_files/usa_names.csv gs://$PROJECT/data_files/

미란 진. · Reviewed over 6 years ago

the copy data files step for usa_names.csv and head_usa_names.csv is not working due to insufficient permission

Ilung P. · Reviewed over 6 years ago

Yogita V. · Reviewed over 6 years ago

Yogita V. · Reviewed over 6 years ago

Some commands needed to add the "--region us-central1" parameter

Jimmy M. · Reviewed over 6 years ago

There was some issue. I have been asked by chat support that this will be resolved later.

Siraj S. · Reviewed over 6 years ago

This lab is full of errors, cannot even be solved with the help of chatters. It is very annoying as it is not a free lab.

Oscar L. · Reviewed over 6 years ago

Errors encountered: (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ gsutil cp gs://spls/gsp290/usa_names.csv gs://$PROJECT/data_files/ CommandException: No URLs matched: gs://spls/gsp290/usa_names.csv (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$ python dataflow_python_examples/data_ingestion.py --project=$PROJECT --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_ingestion.py", line 134, in <module> run() File "dataflow_python_examples/data_ingestion.py", line 100, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/student_04_2e873d239108/professional-services/examples/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/pipeline.py", line 198, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Missing required option: region. (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$

Paul R. · Reviewed over 6 years ago

俊樹 金. · Reviewed over 6 years ago

code is incomplete and doesn't run in latest version oF GCP

George T. · Reviewed over 6 years ago

Ari W. · Reviewed over 6 years ago

could not find the python files

irfan a. · Reviewed over 6 years ago