Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Reviewed מעל שנה אחת ago

Cloud Composer environment not able to be set up

Andrew P. · Reviewed מעל שנה אחת ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Reviewed מעל שנה אחת ago

the build dont work

Jose Javier G. · Reviewed מעל שנה אחת ago

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Reviewed מעל שנה אחת ago

Manuel P. · Reviewed מעל שנה אחת ago

Manuel P. · Reviewed מעל שנה אחת ago

Kevin M. · Reviewed מעל שנה אחת ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed מעל שנה אחת ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed מעל שנה אחת ago

Armin M. · Reviewed מעל שנה אחת ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.8.1-airflow-2.7.3, composer-2.8.1-airflow-2.6.3].

Ike D. · Reviewed מעל שנה אחת ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed מעל שנה אחת ago

lab needs update. Airflow version 1 is not available and code is obsolete

Alexandre Q. · Reviewed מעל שנה אחת ago

Manuel P. · Reviewed מעל שנה אחת ago

El lab está desactualizado y no permite realizarlo correctamente

Luis G. · Reviewed מעל שנה אחת ago

not working

Mikhail K. · Reviewed מעל שנה אחת ago

Ahmad A. · Reviewed מעל שנה אחת ago

lab is broken airflow 1.2 is no more

Diego M. · Reviewed מעל שנה אחת ago

this command doesnt work so had to create composer via console: gcloud composer environments create ... eventually build fails because of Broken DAG: [/home/airflow/gcs/dags/data-pipeline-test.py] so can't progress the lab

Aliaksandr S. · Reviewed מעל שנה אחת ago

Mikhail K. · Reviewed מעל שנה אחת ago

Cloud Shell not opening

Brindha R. · Reviewed מעל שנה אחת ago

09Serverless Data Processing with Dataflow: OperationsServerless Data Processing with Dataflow: Operations - startup command for composer is deprecated... needed to run: gcloud composer environments create $COMPOSER_ENV_NAME     --location $COMPOSER_REGION     --image-version composer-3-airflow-2.9 .1 Create the build and test pipeline Failed: BUILD FAILURE: Build step failure: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1ERROR: (gcloud.builds.submit) build f381c4f9-1e9a-482c-99a9-870ca434e4e3 completed with status "FAILURE" Had to manually rerun the script that fills in the environ variables for composer template (it was empty after running the script as directed) tried fixing code but ran out of time on lab. Fix your code and lab.

Nevin A. · Reviewed מעל שנה אחת ago

Lab is not working. Giving cloud composer and airflow version error

Ashish N. · Reviewed מעל שנה אחת ago

I cannot complete this lab

Victor Hugo V. · Reviewed מעל שנה אחת ago