Serverless Data Processing with Dataflow - Writing an ETL pipeline using Apache Beam and Dataflow (Java) recensioni

During this lab, I repeatedly encountered ZONE_RESOURCE_POOL_EXHAUSTED errors when trying to launch Dataflow jobs. This occurred across multiple zones in both us-east1 and us-west1 regions, making it impossible to complete the lab tasks that require Dataflow. This issue has occurred across multiple lab restarts and sessions. Please investigate resource availability in these regions for Qwiklabs projects

Emerson M. · Recensione inserita circa un'ora fa

Aubin C. · Recensione inserita circa un'ora fa

Laboratorio com erro no link http://35.197.125.188:3000/#/home/project/training-data-analyst/quests/dataflow/no link:

EDUARDO A. · Recensione inserita circa 4 ore fa

Leonardo S. · Recensione inserita circa 6 ore fa

Luis Antonio C. · Recensione inserita circa 9 ore fa

Sriyansh S. · Recensione inserita circa 11 ore fa

TARUN KUMAR S. · Recensione inserita circa 14 ore fa

Seems like a good lesson, but no workers available means it's not possible to go through it properly

Martin H. · Recensione inserita circa 16 ore fa

Sriyansh S. · Recensione inserita circa 20 ore fa

Sriyansh S. · Recensione inserita circa 20 ore fa

Aubin C. · Recensione inserita circa 24 ore fa

The first part of the lab was confusing. The lab gives an ide-url. This was the first time, I saw an ide-url. However, the lab didnt suggest how to use it. I had to do the following out of my own understanding: I had to find a VM Instance in the Project. SSH into it. And then do the following command: cd /home/theia-java-dataflow/training-data-analyst/quests/dataflow/ Maven was not installed, so I had to do the following: sudo apt install maven On running, the following command, I got an error ("ERROR: (gcloud) Invalid choice: 'storage'.") source create_batch_sinks.sh I had to run sudo gcloud components update. Even that didnt work so I had to use echo "Creating pipeline sinks" PROJECT_ID=$(gcloud config get-value project) # GCS buckets #TODO: Add try/catch for the first bucket since qwiklabs #gcloud storage buckets create --location=US gs://$PROJECT_ID gsutil mb -l US gs://$PROJECT_ID #gcloud storage buckets create --location=US --default-storage-class="COLDLINE" gs://$PROJECT_ID-coldline gsutil mb -l US -c COLDLINE gs://$PROJECT_ID-coldline But as several files contained the gcloud commands and I could not change all of the files to gsutil commands. So I had to install a local version of gcloud with the following statements: #Step0: cd ~ #Step1: curl -O https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-cli-linux-x86_64.tar.gz #Step2: tar -xf google-cloud-cli-linux-x86_64.tar.gz #Step3: sudo ./google-cloud-sdk/install.sh I also gto pip3 errors. So I had to install it with below statements: sudo apt-get update sudo apt-get install python3-pip -y Now I am almost at the endo of the lab. I have executed "bash generate_batch_events.sh" but it is stuck at "Installing Packages". I dont think, I would be able to complete the lab.

Sayed Fawad Ali S. · Recensione inserita 1 giorno fa

Sriyansh S. · Recensione inserita 2 giorni fa

Daniel A. · Recensione inserita 3 giorni fa

Gustavo L. · Recensione inserita 3 giorni fa

Ferdie O. · Recensione inserita 4 giorni fa

Harsh A. · Recensione inserita 4 giorni fa

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Recensione inserita 4 giorni fa

Allan L. · Recensione inserita 4 giorni fa

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Recensione inserita 4 giorni fa

Emerson C. · Recensione inserita 4 giorni fa

Iván Marcelo U. · Recensione inserita 5 giorni fa

Francisco M. · Recensione inserita 6 giorni fa

Leonardo M. · Recensione inserita 6 giorni fa

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Recensione inserita 6 giorni fa