Processamento de dados sem servidor com o Dataflow: como criar um pipeline ETL usando Apache Beam e Dataflow (Java) avaliações

TARUN KUMAR S. · Revisado há 5 days

Seems like a good lesson, but no workers available means it's not possible to go through it properly

Martin H. · Revisado há 5 days

Sriyansh S. · Revisado há 5 days

Sriyansh S. · Revisado há 5 days

Aubin C. · Revisado há 5 days

The first part of the lab was confusing. The lab gives an ide-url. This was the first time, I saw an ide-url. However, the lab didnt suggest how to use it. I had to do the following out of my own understanding: I had to find a VM Instance in the Project. SSH into it. And then do the following command: cd /home/theia-java-dataflow/training-data-analyst/quests/dataflow/ Maven was not installed, so I had to do the following: sudo apt install maven On running, the following command, I got an error ("ERROR: (gcloud) Invalid choice: 'storage'.") source create_batch_sinks.sh I had to run sudo gcloud components update. Even that didnt work so I had to use echo "Creating pipeline sinks" PROJECT_ID=$(gcloud config get-value project) # GCS buckets #TODO: Add try/catch for the first bucket since qwiklabs #gcloud storage buckets create --location=US gs://$PROJECT_ID gsutil mb -l US gs://$PROJECT_ID #gcloud storage buckets create --location=US --default-storage-class="COLDLINE" gs://$PROJECT_ID-coldline gsutil mb -l US -c COLDLINE gs://$PROJECT_ID-coldline But as several files contained the gcloud commands and I could not change all of the files to gsutil commands. So I had to install a local version of gcloud with the following statements: #Step0: cd ~ #Step1: curl -O https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-cli-linux-x86_64.tar.gz #Step2: tar -xf google-cloud-cli-linux-x86_64.tar.gz #Step3: sudo ./google-cloud-sdk/install.sh I also gto pip3 errors. So I had to install it with below statements: sudo apt-get update sudo apt-get install python3-pip -y Now I am almost at the endo of the lab. I have executed "bash generate_batch_events.sh" but it is stuck at "Installing Packages". I dont think, I would be able to complete the lab.

Sayed Fawad Ali S. · Revisado há 6 days

Sriyansh S. · Revisado há 7 days

Daniel A. · Revisado há 7 days

Gustavo L. · Revisado há 8 days

Ferdie O. · Revisado há 8 days

Harsh A. · Revisado há 8 days

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Revisado há 9 days

Allan L. · Revisado há 9 days

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Revisado há 9 days

Emerson C. · Revisado há 9 days

Iván Marcelo U. · Revisado há 10 days

Francisco M. · Revisado há 10 days

Leonardo M. · Revisado há 10 days

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Revisado há 10 days

Selina C. · Revisado há 11 days

the ide didn't work

Souhail L. · Revisado há 11 days

Sriyansh S. · Revisado há 11 days

Luis Antonio C. · Revisado há 11 days

Luis Antonio C. · Revisado há 12 days

Daniela L. · Revisado há 13 days