ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews
80622 reviews
煾 雪. · Reviewed over 7 years ago
Biswajit M. · Reviewed over 7 years ago
raghu r. · Reviewed over 7 years ago
ok
Mudji S. · Reviewed over 7 years ago
Damon D. · Reviewed over 7 years ago
Xin Ying L. · Reviewed over 7 years ago
I can't complete this labs due to the following error: Autoscaling: Unable to reach resize target in zone us-central1-a. QUOTA_EXCEEDED: Quota 'SSD_TOTAL_GB' exceeded. Limit: 500.0 in region us-central1
Jeff A. · Reviewed over 7 years ago
Eda D. · Reviewed over 7 years ago
Oscar L. · Reviewed over 7 years ago
Partly Satisfied (60%)
Marcio O. · Reviewed over 7 years ago
Very Satisfied
mohamed b. · Reviewed over 7 years ago
Dominik F. · Reviewed over 7 years ago
Very Satisfied
mohamed b. · Reviewed over 7 years ago
Great
Ferry S. · Reviewed over 7 years ago
Paso 2: Transferencia de datos --> con ERROR python dataflow_python_examples/data_ingestion.py --project=$PROJECT --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session self._validate() File "/home/google3440357_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/options/value_provider.py", line 133, in _f return fnc(self, *args, **kwargs) File "/home/google3440357_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/io/filebasedsource.py", line 176, in _validate match_result = FileSystems.match([pattern], limits=[1])[0] File "/home/google3440357_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/io/filesystems.py", line 166, in match return filesystem.match(patterns, limits) File "/home/google3440357_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/io/filesystem.py", line 604, in match raise BeamIOError("Match operation failed", exceptions) apache_beam.io.filesystem.BeamIOError: Match operation failed with exceptions {'gs://qwiklabs-gcp-b44f66c62d0e5b54/data_files/head_usa_names.csv': SSLHandshakeError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:661)'),)}
Patricio P. · Reviewed over 7 years ago
David Gilberto R. · Reviewed over 7 years ago
Paula Y. · Reviewed over 7 years ago
too urgent
Aaron L. · Reviewed over 7 years ago
Step - Data Ingestion, is not working. When I am running the code to set up spin up workers, I get this error in the cloud shell: "est --temp_location gs://qwiklabs-gcp-3ba1dae8bc3e9b27/test --input gs://qwiklabs-gcp-3ba1dae8bc3e9b27/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_ingestion.py", line 132, in <module> run() File "dataflow_python_examples/data_ingestion.py", line 98, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/google3429393_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/pipeline.py", line 155, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Invalid Project ID (). Please make sure you specified the Project ID, not project number. Invalid GCS path (gs:///test), given for the option: staging_location."
Feyzi B. · Reviewed over 7 years ago
too urgent
Aaron L. · Reviewed over 7 years ago
time constraints
Wei Juin Ong -. · Reviewed over 7 years ago
time constraints
Wei Juin Ong -. · Reviewed over 7 years ago
Time could do with extending slightly.
Andrew H. · Reviewed over 7 years ago
Step - Data Ingestion, is not working. When I am running the code to set up spin up workers, I get this error in the cloud shell: "est --temp_location gs://qwiklabs-gcp-3ba1dae8bc3e9b27/test --input gs://qwiklabs-gcp-3ba1dae8bc3e9b27/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_ingestion.py", line 132, in <module> run() File "dataflow_python_examples/data_ingestion.py", line 98, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/home/google3429393_student/professional-services/examples/dataflow-python-examples/dataflow-env/local/lib/python2.7/site-packages/apache_beam/pipeline.py", line 155, in __init__ 'Pipeline has validations errors: \n' + '\n'.join(errors)) ValueError: Pipeline has validations errors: Invalid Project ID (). Please make sure you specified the Project ID, not project number. Invalid GCS path (gs:///test), given for the option: staging_location."
Feyzi B. · Reviewed over 7 years ago
Ike C. · Reviewed over 7 years ago
We do not ensure the published reviews originate from consumers who have purchased or used the products. Reviews are not verified by Google.