Serverless Data Processing with Dataflow - Writing an ETL Pipeline using Apache Beam and Dataflow (Python) Reviews

Good

Ravikumar M. · Reviewed 12 דקות ago

The environment seems to be misconfigured. I got a lot of these trying to run the pipeline: WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1017)'))': /computeMetadata/v1/instance/service-accounts/default/?recursive=true Unable to progress

Martin H. · Reviewed בערך 4 שעות ago

Robert A. · Reviewed בערך 7 שעות ago

Leela Bhargavi B. · Reviewed בערך 9 שעות ago

Pipeline ran with DirectRunner, but the check my progress did not detect the completed pipeline. Dataflow runner had 400 HTTP error

Brian H. · Reviewed בערך 16 שעות ago

Paige T. · Reviewed בערך 17 שעות ago

Yan H. · Reviewed בערך 20 שעות ago

kept getting error at the PCollection portion of the training.

Jackie D. · Reviewed בערך 20 שעות ago

user name and password not working

Jackie D. · Reviewed בערך 22 שעות ago

good

Ravindra M. · Reviewed יום אחד ago

Ashok K. · Reviewed יום אחד ago

Connection errors

Yvonne D. · Reviewed יום אחד ago

Connection errors

Yvonne D. · Reviewed יום אחד ago

didnt work

SEBASTIAN FERNANDO M. · Reviewed יום אחד ago

keep on getting same error when trying to do task 6: startup of the worker pool in us-central-*whatever zone i change to* failed to bring up any of desired 1 workers. no matter which zone i change to!

Simon K. · Reviewed יום אחד ago

Could not complete Part1 Task 6 run the pipeline (using the provided Solution code) due to the following error: raise BeamIOError("Match operation failed", exceptions) apache_beam.io.filesystem.BeamIOError: Match operation failed with exceptions {'gs://qwiklabs-gcp-00-f5855126f119/events.json': RefreshError(TransportError("Failed to retrieve https://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true from the Google Compute Engine metadata service. Compute Engine Metadata server unavailable. Last exception: HTTPSConnectionPool(host='metadata.google.internal', port=443): Max retries exceeded with url: /computeMetadata/v1/instance/service-accounts/default/?recursive=true (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1017)')))"))}; time is too short to complete part1&part2 together.

Lingmin M. · Reviewed יום אחד ago

Too complicated.

Sergi F. · Reviewed 2 ימים ago

Can I add ZERO stars here? This lab is terrible.

Dessa O. · Reviewed 2 ימים ago

Jackie D. · Reviewed 3 ימים ago

wasnt able to create the instance due resource limits

Virginia M. · Reviewed 3 ימים ago

My conclusion from this lab is that I should not use or depend on this type of platform for production loads. It if does not even work in a controlled lab, then production is a no-go! ERROR:apache_beam.runners.dataflow.dataflow_runner:2026-04-01T09:25:07.346Z: JOB_MESSAGE_ERROR: Startup of the worker pool in us-central1 failed to bring up any of the desired 1 workers. This is likely a quota issue or a Compute Engine stockout. The service will retry. For troubleshooting steps, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-pool-failure for help troubleshooting. ZONE_RESOURCE_POOL_EXHAUSTED: Instance 'my-pipeline-1775035379230-04010223-mm24-harness-86c2' creation failed: The zone 'projects/qwiklabs-gcp-02-e142b19585b8/zones/us-central1-a' does not have enough resources available to fulfill the request. Try a different zone, or try again later.

Mikael W. · Reviewed 3 ימים ago

Sriyansh S. · Reviewed 3 ימים ago

Harsh A. · Reviewed 3 ימים ago

Harsh A. · Reviewed 3 ימים ago

Not clear

Shitab T. · Reviewed 4 ימים ago