ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

got access denied error when trying to copy csv files from python-dataflow-example bucket

David S. · Reviewed 6 yıldan fazla ago

Lot of mistakes on the lab difficult to figure out things

Juby J. · Reviewed 6 yıldan fazla ago

gs://spls/gsp290/usa_names.csv does not exist

Herman M. · Reviewed 6 yıldan fazla ago

Arnaldo B. · Reviewed 6 yıldan fazla ago

Not satisfied. This lab is garbage. All commands and code are wrong missing regional args and do not correspond to instructions. Files located in incorrect bucket locations. This was a waste fo time and credits. Garbage.

Gray L. · Reviewed 6 yıldan fazla ago

error with copying into bucket storage

Jessica Y. · Reviewed 6 yıldan fazla ago

not able to complete it

Kashish S. · Reviewed 6 yıldan fazla ago

good

aanand k. · Reviewed 6 yıldan fazla ago

Yogita V. · Reviewed 6 yıldan fazla ago

Some steps are outdated (couldn´t find usa_names.csv). Also when I trid some "apache beam pipeline" steps, my machine never stopped processing, therefore I couldn´t finish the lab :c.

Dante -. · Reviewed 6 yıldan fazla ago

data_transformation.py looks almost empty!!

KOJI I. · Reviewed 6 yıldan fazla ago

Antonio B. · Reviewed 6 yıldan fazla ago

Command provided not matching. No direction for troubleshooting

Mohammad Kamar U. · Reviewed 6 yıldan fazla ago

$ gsutil cp gs://spls/gsp290/data_files/usa_names.csv gs://$PROJECT/data_files/

미란 진. · Reviewed 6 yıldan fazla ago

the copy data files step for usa_names.csv and head_usa_names.csv is not working due to insufficient permission

Ilung P. · Reviewed 6 yıldan fazla ago

Yogita V. · Reviewed 6 yıldan fazla ago

Yogita V. · Reviewed 6 yıldan fazla ago

Some commands needed to add the "--region us-central1" parameter

Jimmy M. · Reviewed 6 yıldan fazla ago

There was some issue. I have been asked by chat support that this will be resolved later.

Siraj S. · Reviewed 6 yıldan fazla ago

This lab is full of errors, cannot even be solved with the help of chatters. It is very annoying as it is not a free lab.

Oscar L. · Reviewed 6 yıldan fazla ago

Errors encountered: (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ gsutil cp gs://spls/gsp290/usa_names.csv gs://$PROJECT/data_files/ CommandException: No URLs matched: gs://spls/gsp290/usa_names.csv (venv) student_04_2e873d239108@cloudshell:~ (qwiklabs-gcp-04-d9e92eb486d7)$ (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$ python dataflow_python_examples/data_ingestion.py --project=$PROJECT --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_ingestion.py", line 134, in <module> run() File "dataflow_python_examples/data_ingestion.py", line 100, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/student_04_2e873d239108/professional-services/examples/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/pipeline.py", line 198, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Missing required option: region. (venv) student_04_2e873d239108@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-04-d9e92eb486d7)$

Paul R. · Reviewed 6 yıldan fazla ago

俊樹 金. · Reviewed 6 yıldan fazla ago

code is incomplete and doesn't run in latest version oF GCP

George T. · Reviewed 6 yıldan fazla ago

Ari W. · Reviewed 6 yıldan fazla ago

could not find the python files

irfan a. · Reviewed 6 yıldan fazla ago