Serverless Data Processing with Dataflow - Writing an ETL pipeline using Apache Beam and Dataflow (Java) recensioni

Luis Antonio C. · Recensione inserita circa un'ora fa

Sriyansh S. · Recensione inserita circa 3 ore fa

TARUN KUMAR S. · Recensione inserita circa 5 ore fa

Seems like a good lesson, but no workers available means it's not possible to go through it properly

Martin H. · Recensione inserita circa 8 ore fa

Sriyansh S. · Recensione inserita circa 12 ore fa

Sriyansh S. · Recensione inserita circa 12 ore fa

Aubin C. · Recensione inserita circa 15 ore fa

The first part of the lab was confusing. The lab gives an ide-url. This was the first time, I saw an ide-url. However, the lab didnt suggest how to use it. I had to do the following out of my own understanding: I had to find a VM Instance in the Project. SSH into it. And then do the following command: cd /home/theia-java-dataflow/training-data-analyst/quests/dataflow/ Maven was not installed, so I had to do the following: sudo apt install maven On running, the following command, I got an error ("ERROR: (gcloud) Invalid choice: 'storage'.") source create_batch_sinks.sh I had to run sudo gcloud components update. Even that didnt work so I had to use echo "Creating pipeline sinks" PROJECT_ID=$(gcloud config get-value project) # GCS buckets #TODO: Add try/catch for the first bucket since qwiklabs #gcloud storage buckets create --location=US gs://$PROJECT_ID gsutil mb -l US gs://$PROJECT_ID #gcloud storage buckets create --location=US --default-storage-class="COLDLINE" gs://$PROJECT_ID-coldline gsutil mb -l US -c COLDLINE gs://$PROJECT_ID-coldline But as several files contained the gcloud commands and I could not change all of the files to gsutil commands. So I had to install a local version of gcloud with the following statements: #Step0: cd ~ #Step1: curl -O https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-cli-linux-x86_64.tar.gz #Step2: tar -xf google-cloud-cli-linux-x86_64.tar.gz #Step3: sudo ./google-cloud-sdk/install.sh I also gto pip3 errors. So I had to install it with below statements: sudo apt-get update sudo apt-get install python3-pip -y Now I am almost at the endo of the lab. I have executed "bash generate_batch_events.sh" but it is stuck at "Installing Packages". I dont think, I would be able to complete the lab.

Sayed Fawad Ali S. · Recensione inserita circa 23 ore fa

Sriyansh S. · Recensione inserita 2 giorni fa

Daniel A. · Recensione inserita 3 giorni fa

Gustavo L. · Recensione inserita 3 giorni fa

Ferdie O. · Recensione inserita 4 giorni fa

Harsh A. · Recensione inserita 4 giorni fa

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Recensione inserita 4 giorni fa

Allan L. · Recensione inserita 4 giorni fa

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Recensione inserita 4 giorni fa

Emerson C. · Recensione inserita 4 giorni fa

Iván Marcelo U. · Recensione inserita 5 giorni fa

Francisco M. · Recensione inserita 5 giorni fa

Leonardo M. · Recensione inserita 5 giorni fa

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Recensione inserita 6 giorni fa

Selina C. · Recensione inserita 6 giorni fa

the ide didn't work

Souhail L. · Recensione inserita 6 giorni fa

Sriyansh S. · Recensione inserita 7 giorni fa

Luis Antonio C. · Recensione inserita 7 giorni fa