Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Reviewed over 1 year ago

Cloud Composer environment not able to be set up

Andrew P. · Reviewed over 1 year ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Reviewed over 1 year ago

the build dont work

Jose Javier G. · Reviewed over 1 year ago

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Reviewed over 1 year ago

Manuel P. · Reviewed over 1 year ago

Manuel P. · Reviewed over 1 year ago

Kevin M. · Reviewed over 1 year ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed over 1 year ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed over 1 year ago

Armin M. · Reviewed over 1 year ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.8.1-airflow-2.7.3, composer-2.8.1-airflow-2.6.3].

Ike D. · Reviewed over 1 year ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed over 1 year ago

lab needs update. Airflow version 1 is not available and code is obsolete

Alexandre Q. · Reviewed over 1 year ago

Manuel P. · Reviewed over 1 year ago

El lab está desactualizado y no permite realizarlo correctamente

Luis G. · Reviewed over 1 year ago

not working

Mikhail K. · Reviewed over 1 year ago

Ahmad A. · Reviewed over 1 year ago

lab is broken airflow 1.2 is no more

Diego M. · Reviewed over 1 year ago

this command doesnt work so had to create composer via console: gcloud composer environments create ... eventually build fails because of Broken DAG: [/home/airflow/gcs/dags/data-pipeline-test.py] so can't progress the lab

Aliaksandr S. · Reviewed over 1 year ago

Mikhail K. · Reviewed over 1 year ago

Cloud Shell not opening

Brindha R. · Reviewed over 1 year ago

09Serverless Data Processing with Dataflow: OperationsServerless Data Processing with Dataflow: Operations - startup command for composer is deprecated... needed to run: gcloud composer environments create $COMPOSER_ENV_NAME     --location $COMPOSER_REGION     --image-version composer-3-airflow-2.9 .1 Create the build and test pipeline Failed: BUILD FAILURE: Build step failure: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1ERROR: (gcloud.builds.submit) build f381c4f9-1e9a-482c-99a9-870ca434e4e3 completed with status "FAILURE" Had to manually rerun the script that fills in the environ variables for composer template (it was empty after running the script as directed) tried fixing code but ran out of time on lab. Fix your code and lab.

Nevin A. · Reviewed over 1 year ago

Lab is not working. Giving cloud composer and airflow version error

Ashish N. · Reviewed over 1 year ago

I cannot complete this lab

Victor Hugo V. · Reviewed over 1 year ago