Serverless Data Processing with Dataflow - Writing an ETL Pipeline using Apache Beam and Dataflow (Python) Reviews

Like other DataFlow Labs, this lab could not get completed because of Compute Engine stockout/quota issue. I believe its lab resources issue because I tried 3 different labs with 3 different regions (us-west1, us-east1, us-central1) but the DF jobs failed in all.

Sayed Fawad Ali S. · Reviewed 5 hours ago

Part2 failed without error message

Lingmin M. · Reviewed 11 hours ago

zero stars/. First the lab doesnt run based on instructions. Even when I make my own fixes and run everythign on the lab successfully, the progress doesnt' capture on the progress log. I should show as 100% completed but it doesnt. Keeps saying you havent completed this task when I can actually see all my files and BQ table that I created

Jyoti V. · Reviewed 11 hours ago

Good

Ravikumar M. · Reviewed 16 hours ago

The environment seems to be misconfigured. I got a lot of these trying to run the pipeline: WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1017)'))': /computeMetadata/v1/instance/service-accounts/default/?recursive=true Unable to progress

Martin H. · Reviewed 20 hours ago

Robert A. · Reviewed 23 hours ago

Leela Bhargavi B. · Reviewed 1 day ago

Pipeline ran with DirectRunner, but the check my progress did not detect the completed pipeline. Dataflow runner had 400 HTTP error

Brian H. · Reviewed 1 day ago

Paige T. · Reviewed 1 day ago

Yan H. · Reviewed 1 day ago

kept getting error at the PCollection portion of the training.

Jackie D. · Reviewed 1 day ago

user name and password not working

Jackie D. · Reviewed 1 day ago

good

Ravindra M. · Reviewed 2 days ago

Ashok K. · Reviewed 2 days ago

Connection errors

Yvonne D. · Reviewed 2 days ago

Connection errors

Yvonne D. · Reviewed 2 days ago

didnt work

SEBASTIAN FERNANDO M. · Reviewed 2 days ago

keep on getting same error when trying to do task 6: startup of the worker pool in us-central-*whatever zone i change to* failed to bring up any of desired 1 workers. no matter which zone i change to!

Simon K. · Reviewed 2 days ago

Could not complete Part1 Task 6 run the pipeline (using the provided Solution code) due to the following error: raise BeamIOError("Match operation failed", exceptions) apache_beam.io.filesystem.BeamIOError: Match operation failed with exceptions {'gs://qwiklabs-gcp-00-f5855126f119/events.json': RefreshError(TransportError("Failed to retrieve https://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true from the Google Compute Engine metadata service. Compute Engine Metadata server unavailable. Last exception: HTTPSConnectionPool(host='metadata.google.internal', port=443): Max retries exceeded with url: /computeMetadata/v1/instance/service-accounts/default/?recursive=true (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1017)')))"))}; time is too short to complete part1&part2 together.

Lingmin M. · Reviewed 2 days ago

Too complicated.

Sergi F. · Reviewed 3 days ago

Can I add ZERO stars here? This lab is terrible.

Dessa O. · Reviewed 3 days ago

Jackie D. · Reviewed 3 days ago

wasnt able to create the instance due resource limits

Virginia M. · Reviewed 4 days ago

My conclusion from this lab is that I should not use or depend on this type of platform for production loads. It if does not even work in a controlled lab, then production is a no-go! ERROR:apache_beam.runners.dataflow.dataflow_runner:2026-04-01T09:25:07.346Z: JOB_MESSAGE_ERROR: Startup of the worker pool in us-central1 failed to bring up any of the desired 1 workers. This is likely a quota issue or a Compute Engine stockout. The service will retry. For troubleshooting steps, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-pool-failure for help troubleshooting. ZONE_RESOURCE_POOL_EXHAUSTED: Instance 'my-pipeline-1775035379230-04010223-mm24-harness-86c2' creation failed: The zone 'projects/qwiklabs-gcp-02-e142b19585b8/zones/us-central1-a' does not have enough resources available to fulfill the request. Try a different zone, or try again later.

Mikael W. · Reviewed 4 days ago

Sriyansh S. · Reviewed 4 days ago