Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

Cloudbuild step fails as SDK is out of date. Had to go in and manually add allowFailure: true to the cloudbuild steps 6 and 10. Ran out of time as was spent debugging qwiklabs code!

Eilidh M. · Reviewed about 3 years ago

iuytrsexdcf

Shabaz S. · Reviewed about 3 years ago

some issue with gke composer versions causing the commands failing in build.

Ajaya Kumar B. · Reviewed about 3 years ago

oujnm

Shabaz S. · Reviewed about 3 years ago

BUILD FAILURE: Build step failure: build step 1 "gcr.io/cloud-builders/mvn:3.5.0-jdk-8" failed: step exited with non-zero status: 1

Adolfo C. · Reviewed about 3 years ago

Tianchi L. · Reviewed about 3 years ago

ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable, when running gcloud composer environments run, in multiple steps of this lab

Ana S. · Reviewed about 3 years ago

ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable

Tomás M. · Reviewed about 3 years ago

The same error " ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable If you would like to report this issue, please run the following command:"

Aymen H. · Reviewed about 3 years ago

I don't know why gcloud is crashing. I will investigate further.

Nixon M. · Reviewed about 3 years ago

Rainier Gemuel T. · Reviewed about 3 years ago

Cesar B. · Reviewed about 3 years ago

ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable when running set_composer_variables.sh. Same error when creating the first pipeline. Different error when creating the second pipeline

Ana S. · Reviewed about 3 years ago

Ryo M. · Reviewed about 3 years ago

Ana S. · Reviewed about 3 years ago

broken

Or M. · Reviewed about 3 years ago

cd ~/ci-cd-for-data-processing-workflow/env-setup chmod +x set_composer_variables.sh ./set_composer_variables.sh kubeconfig entry generated for us-central1-data-pipeline-c-2f95a529-gke. Executing within the following Kubernetes cluster namespace: composer-1-20-1-airflow-1-10-15-2f95a529 [2022-12-11 07:58:50,483] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg [2022-12-11 07:58:50,675] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg Missing variables file. ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable

ritesh v. · Reviewed about 3 years ago

Broken lab: gcloud composer environments run \ ${COMPOSER_ENV_NAME} \ --location ${COMPOSER_REGION} \ variables import -- /home/airflow/gcs/data/${COMPOSER_VAR_FILE} fails with none type error

Chase M. · Reviewed about 3 years ago

Syed H. · Reviewed about 3 years ago

Erie B. · Reviewed about 3 years ago

I have tried this lab "Serverless Data Processing with Dataflow - CI/CD with Dataflow" several times, each time during the "task 5: Creating Cloud Build pipelines " in the "step: Create the build and test pipeline" when i run the following code in cloud shell: " cd ~/ci-cd-for-data-processing-workflow/source-code/build-pipeline gcloud builds submit --config=build_deploy_test.yaml --substitutions=\ REPO_NAME=$SOURCE_CODE_REPO,\ _DATAFLOW_JAR_BUCKET=$DATAFLOW_JAR_BUCKET_TEST,\ _COMPOSER_INPUT_BUCKET=$INPUT_BUCKET_TEST,\ _COMPOSER_REF_BUCKET=$REF_BUCKET_TEST,\ _COMPOSER_DAG_BUCKET=$COMPOSER_DAG_BUCKET,\ _COMPOSER_ENV_NAME=$COMPOSER_ENV_NAME,\ _COMPOSER_REGION=$COMPOSER_REGION,\ _COMPOSER_DAG_NAME_TEST=$COMPOSER_DAG_NAME_TEST " it returns this error: "Finished Step #6 - "set-composer-jar-ref" ERROR ERROR: build step 6 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1"

Aymen H. · Reviewed about 3 years ago

Vinu N. · Reviewed about 3 years ago

Ahmad S. · Reviewed about 3 years ago

Vinu N. · Reviewed about 3 years ago

Pipeline failed 5 times to build due to this "(TypeError): 'NoneType' object is not callable" error, even though instructions were strictly followed.

Luisa Fernanda A. · Reviewed about 3 years ago