Processamento de dados sem servidor com o Dataflow: como criar um Pipeline ETL usando Apache Beam e Dataflow (Python) avaliações

Logan S. · Revisado há 2 months

Gustavo L. · Revisado há 2 months

Martin G. · Revisado há 2 months

Trying to run the job fails with SSL cert error

Fernanda C. · Revisado há 2 months

Daniel A. · Revisado há 2 months

Connection errors

Yvonne D. · Revisado há 2 months

Wei Z. · Revisado há 2 months

SSL certificate verify failed error prevented me from completing the lab

Brian H. · Revisado há 2 months

Wei Z. · Revisado há 2 months

Wei Z. · Revisado há 2 months

Harsh A. · Revisado há 2 months

Leonardo S. · Revisado há 2 months

Unsure how to resolve error when running pipeline WARNING:google.auth.compute engine.metadata:Compute Engine Metadata server unavailable on attempt 1 of 3. Reason: http.client transport only supports the http scheme, https is specified

Ivan L. · Revisado há 2 months

the lab cfails to provission workers to the dataflow jobs, no matter if the machine types are stated explicitely.

Iván Marcelo U. · Revisado há 2 months

Yan H. · Revisado há 2 months

Svetak S. · Revisado há 2 months

Francisco M. · Revisado há 2 months

Leonardo M. · Revisado há 2 months

Issue with the project id. There is no parent organization to select.

Vanitha H. · Revisado há 2 months

médiocre

Kasraoui W. · Revisado há 2 months

Igor d. · Revisado há 2 months

Ana N. · Revisado há 2 months

having error on Run your pipeline task, even using the solution code provided in the lab. Traceback (most recent call last): File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/my_pipeline.py", line 108, in <module> run() File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/my_pipeline.py", line 92, in run | 'ReadFromGCS' >> beam.io.ReadFromText(input) File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/io/textio.py", line 808, in __init__ self._source = self._source_class( File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/io/textio.py", line 144, in __init__ super().__init__( File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/io/filebasedsource.py", line 127, in __init__ self._validate() File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/options/value_provider.py", line 193, in _f return fnc(self, *args, **kwargs) File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/io/filebasedsource.py", line 190, in _validate match_result = FileSystems.match([pattern], limits=[1])[0] File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/io/filesystems.py", line 240, in match return filesystem.match(patterns, limits) File "/home/jupyter/training-data-analyst/quests/dataflow_python/1_Basic_ETL/lab/df-env/lib/python3.10/site-packages/apache_beam/io/filesystem.py", line 779, in match raise BeamIOError("Match operation failed", exceptions) apache_beam.io.filesystem.BeamIOError: Match operation failed with exceptions {'gs://qwiklabs-gcp-02-c763640af21b/events.json': RefreshError(TransportError("Failed to retrieve https://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true from the Google Compute Engine metadata service. Compute Engine Metadata server unavailable. Last exception: HTTPSConnectionPool(host='metadata.google.internal', port=443): Max retries exceeded with url: /computeMetadata/v1/instance/service-accounts/default/?recursive=true (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1017)')))"))}

yumeng y. · Revisado há 2 months

proper folders were not cloned for all the tasks

Shaik S. · Revisado há 2 months

Sriyansh S. · Revisado há 2 months