ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

got access denied error when trying to copy csv files from python-dataflow-example bucket

David S. · Reviewed מעל 6 שנים ago

Lot of mistakes on the lab difficult to figure out things

Juby J. · Reviewed מעל 6 שנים ago

gs://spls/gsp290/usa_names.csv does not exist

Herman M. · Reviewed מעל 6 שנים ago

Arnaldo B. · Reviewed מעל 6 שנים ago

Not satisfied. This lab is garbage. All commands and code are wrong missing regional args and do not correspond to instructions. Files located in incorrect bucket locations. This was a waste fo time and credits. Garbage.

Gray L. · Reviewed מעל 6 שנים ago

error with copying into bucket storage

Jessica Y. · Reviewed מעל 6 שנים ago

not able to complete it

Kashish S. · Reviewed מעל 6 שנים ago

good

aanand k. · Reviewed מעל 6 שנים ago

Yogita V. · Reviewed מעל 6 שנים ago

Some steps are outdated (couldn´t find usa_names.csv). Also when I trid some "apache beam pipeline" steps, my machine never stopped processing, therefore I couldn´t finish the lab :c.

Dante -. · Reviewed מעל 6 שנים ago

data_transformation.py looks almost empty!!

KOJI I. · Reviewed מעל 6 שנים ago

Antonio B. · Reviewed מעל 6 שנים ago

Command provided not matching. No direction for troubleshooting

Mohammad Kamar U. · Reviewed מעל 6 שנים ago

$ gsutil cp gs://spls/gsp290/data_files/usa_names.csv gs://$PROJECT/data_files/

미란 진. · Reviewed מעל 6 שנים ago

the copy data files step for usa_names.csv and head_usa_names.csv is not working due to insufficient permission

Ilung P. · Reviewed מעל 6 שנים ago

Yogita V. · Reviewed מעל 6 שנים ago

Yogita V. · Reviewed מעל 6 שנים ago

Some commands needed to add the "--region us-central1" parameter

Jimmy M. · Reviewed מעל 6 שנים ago

There was some issue. I have been asked by chat support that this will be resolved later.

Siraj S. · Reviewed מעל 6 שנים ago

This lab is full of errors, cannot even be solved with the help of chatters. It is very annoying as it is not a free lab.

Oscar L. · Reviewed מעל 6 שנים ago

Errors encountered: (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ gsutil cp gs://spls/gsp290/usa_names.csv gs://$PROJECT/data_files/ CommandException: No URLs matched: gs://spls/gsp290/usa_names.csv (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$ python dataflow_python_examples/data_ingestion.py --project=$PROJECT --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_ingestion.py", line 134, in <module> run() File "dataflow_python_examples/data_ingestion.py", line 100, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/student_04_2e873d239108/professional-services/examples/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/pipeline.py", line 198, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Missing required option: region. (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$

Paul R. · Reviewed מעל 6 שנים ago

俊樹 金. · Reviewed מעל 6 שנים ago

code is incomplete and doesn't run in latest version oF GCP

George T. · Reviewed מעל 6 שנים ago

Ari W. · Reviewed מעל 6 שנים ago

could not find the python files

irfan a. · Reviewed מעל 6 שנים ago