Serverless Data Processing with Dataflow - CI/CD with Dataflow avis

NA

Nenavath R. · Examiné il y a 6 mois

Steven B. · Examiné il y a 6 mois

This had 2 blockers. The 2nd killed my 1st attempt. 1. Airflow version non-existent anymore, had to pick one from https://cloud.google.com/composer/docs/concepts/versioning/composer-versions instead. 2. (stage: watching Airflow DAGs) The default regions setup blows up during the first task. Says constraints/gcp.resourceLocations is violated, because f--k us-central1. The student can't adjust those permissions because they have no editor rights.

Anna E. · Examiné il y a 6 mois

Kamala Krishnan S. · Examiné il y a 6 mois

I've tried more than a dozen times. It always fails on the DAG run.

Flavio B. · Examiné il y a 6 mois

Luke M. · Examiné il y a 6 mois

Monica C. · Examiné il y a 6 mois

Simone G. · Examiné il y a 6 mois

Cecilia Belen B. · Examiné il y a 6 mois

Simone G. · Examiné il y a 6 mois

Lots of commands not working on this lab! test_work_count DAG keeps failing. I'm assuming because of incorrect region which should be asia-east1 instead of us-central1. I made sure I run all the commands to set up the region and zone variables to asia-east1 but not sure why region is incorrect in the jar file. Running command: java -jar /tmp/tmpjnvtv59_dataflow_deployment_106c05a3-bb57-41d1-b2ee-386581a6109b.jar --runner=DataflowRunner --project=qwiklabs-gcp-00-436813f80158 --zone=asia-east1-a --region=us-central1 --stagingLocation=gs://qwiklabs-gcp-00-436813f80158-dataflow-staging-test/staging --jobName=wordcount-run-081da930 --autoscalingAlgorithm=THROUGHPUT_BASED --maxNumWorkers=3 --inputFile=gs://qwiklabs-gcp-00-436813f80158-composer-input-test/input.txt --output=gs://qwiklabs-gcp-00-436813f80158-composer-result-test/output '--labels={"airflow-version":"v2-10-2-composer"}'

Oscar F. · Examiné il y a 6 mois

Puneet P. · Examiné il y a 6 mois

end

Karthik C. · Examiné il y a 6 mois

Kevin A. · Examiné il y a 6 mois

Ashwani Kumar S. · Examiné il y a 6 mois

Jesus C. · Examiné il y a 6 mois

Karthik C. · Examiné il y a 6 mois

Alok P. · Examiné il y a 6 mois

Yitshak S. · Examiné il y a 6 mois

Yitshak S. · Examiné il y a 6 mois

there is a error in the scripts for this lab, the region is supposed to be us-east4 but in the dag pipeline the region automatically switches to us-central-1 which is causing the build to fail and i am unable to complete the lab. Fix this ASAP!!!!!

Raheel K. · Examiné il y a 6 mois

This is possibly the worst lab i have ever encountered. The commands here dont even work

Raheel K. · Examiné il y a 6 mois

Yitshak S. · Examiné il y a 6 mois

Unable to finish the lap, due to the location constraint. The airflows runs the dag in us-central which is forbidden. Even though the env variables were set to us-east

Dominik P. · Examiné il y a 6 mois

NA

Namachivayam R. · Examiné il y a 6 mois