리뷰 Serverless Data Processing with Dataflow - CI/CD with Dataflow개

Broken lab: gcloud composer environments run \ ${COMPOSER_ENV_NAME} \ --location ${COMPOSER_REGION} \ variables import -- /home/airflow/gcs/data/${COMPOSER_VAR_FILE} fails with none type error

Chase M. · 2년 초과 전에 리뷰됨

Syed H. · 2년 초과 전에 리뷰됨

Erie B. · 2년 초과 전에 리뷰됨

I have tried this lab "Serverless Data Processing with Dataflow - CI/CD with Dataflow" several times, each time during the "task 5: Creating Cloud Build pipelines " in the "step: Create the build and test pipeline" when i run the following code in cloud shell: " cd ~/ci-cd-for-data-processing-workflow/source-code/build-pipeline gcloud builds submit --config=build_deploy_test.yaml --substitutions=\ REPO_NAME=$SOURCE_CODE_REPO,\ _DATAFLOW_JAR_BUCKET=$DATAFLOW_JAR_BUCKET_TEST,\ _COMPOSER_INPUT_BUCKET=$INPUT_BUCKET_TEST,\ _COMPOSER_REF_BUCKET=$REF_BUCKET_TEST,\ _COMPOSER_DAG_BUCKET=$COMPOSER_DAG_BUCKET,\ _COMPOSER_ENV_NAME=$COMPOSER_ENV_NAME,\ _COMPOSER_REGION=$COMPOSER_REGION,\ _COMPOSER_DAG_NAME_TEST=$COMPOSER_DAG_NAME_TEST " it returns this error: "Finished Step #6 - "set-composer-jar-ref" ERROR ERROR: build step 6 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1"

Aymen H. · 2년 초과 전에 리뷰됨

Vinu N. · 2년 초과 전에 리뷰됨

Ahmad S. · 2년 초과 전에 리뷰됨

Vinu N. · 2년 초과 전에 리뷰됨

Pipeline failed 5 times to build due to this "(TypeError): 'NoneType' object is not callable" error, even though instructions were strictly followed.

Luisa Fernanda A. · 2년 초과 전에 리뷰됨

Aymen H. · 2년 초과 전에 리뷰됨

I can't start the job. I get the following message when I execute the submit message: gcloud builds submit --config=build_deploy_test.yaml --substitutions=REPO_NAME=$SOURCE_CODE_REPO,\ _DATAFLOW_JAR_BUCKET=$DATAFLOW_JAR_BUCKET_TEST,\ _COMPOSER_INPUT_BUCKET=$INPUT_BUCKET_TEST,\ _COMPOSER_REF_BUCKET=$REF_BUCKET_TEST,\ _COMPOSER_DAG_BUCKET=$COMPOSER_DAG_BUCKET,\ _COMPOSER_ENV_NAME=$COMPOSER_ENV_NAME,\ _COMPOSER_REGION=$COMPOSER_REGION,\ _COMPOSER_DAG_NAME_TEST=$COMPOSER_DAG_NAME_TEST tep #6 - "set-composer-jar-ref": [2022-12-08 03:47:17,041] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg Step #6 - "set-composer-jar-ref": Finished Step #6 - "set-composer-jar-ref"

Ali M. · 2년 초과 전에 리뷰됨

broken

Or M. · 2년 초과 전에 리뷰됨

Step #6 - "set-composer-jar-ref": ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable

Alejandro M. · 2년 초과 전에 리뷰됨

build fails at step 6 for Task 5 when creating the Cloud Build pipeline

Alexandre M. · 2년 초과 전에 리뷰됨

I can't start the job. I get the following message when I execute the submit message: gcloud builds submit --config=build_deploy_test.yaml --substitutions=REPO_NAME=$SOURCE_CODE_REPO,\ _DATAFLOW_JAR_BUCKET=$DATAFLOW_JAR_BUCKET_TEST,\ _COMPOSER_INPUT_BUCKET=$INPUT_BUCKET_TEST,\ _COMPOSER_REF_BUCKET=$REF_BUCKET_TEST,\ _COMPOSER_DAG_BUCKET=$COMPOSER_DAG_BUCKET,\ _COMPOSER_ENV_NAME=$COMPOSER_ENV_NAME,\ _COMPOSER_REGION=$COMPOSER_REGION,\ _COMPOSER_DAG_NAME_TEST=$COMPOSER_DAG_NAME_TEST tep #6 - "set-composer-jar-ref": [2022-12-08 03:47:17,041] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg Step #6 - "set-composer-jar-ref": Finished Step #6 - "set-composer-jar-ref"

Ali M. · 2년 초과 전에 리뷰됨

task2 could not finish. lab is broken.

雄 赤. · 2년 초과 전에 리뷰됨

Chase M. · 2년 초과 전에 리뷰됨

BHASKAR B. · 2년 초과 전에 리뷰됨

After the first incomplete command line that i completed via https://cloud.google.com/architecture/cicd-pipeline-for-data-processing, I ran into multiple errors while trying to create the composer instance

Lucas L. · 2년 초과 전에 리뷰됨

Errors chmod +x set_composer_variables.sh ./set_composer_variables.sh kubeconfig entry generated for us-central1-data-pipeline-c-40b4f095-gke. Executing within the following Kubernetes cluster namespace: composer-1-20-0-airflow-1-10-15-40b4f095 [2022-12-07 15:49:02,061] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg [2022-12-07 15:49:02,207] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg 15 of 15 variables successfully updated. ERROR: gcloud crashed (TypeError): 'NoneType' object is not callable can not complete

Rodrigo A. · 2년 초과 전에 리뷰됨

Lab is broken

Victor S. · 2년 초과 전에 리뷰됨

Stefan L. · 2년 초과 전에 리뷰됨

Rafael G. · 2년 초과 전에 리뷰됨

Facundo V. · 2년 초과 전에 리뷰됨

David C. · 2년 초과 전에 리뷰됨

Prajakta K. · 2년 초과 전에 리뷰됨