Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

task 2 image version noted for composer is not supported

Graham B. · Reviewed أكثر من سنة ago

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Reviewed أكثر من سنة ago

Cloud Composer environment not able to be set up

Andrew P. · Reviewed أكثر من سنة ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Reviewed أكثر من سنة ago

the build dont work

Jose Javier G. · Reviewed أكثر من سنة ago

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Reviewed أكثر من سنة ago

Manuel P. · Reviewed أكثر من سنة ago

Manuel P. · Reviewed أكثر من سنة ago

Kevin M. · Reviewed أكثر من سنة ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed أكثر من سنة ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed أكثر من سنة ago

Armin M. · Reviewed أكثر من سنة ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.8.1-airflow-2.7.3, composer-2.8.1-airflow-2.6.3].

Ike D. · Reviewed أكثر من سنة ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed أكثر من سنة ago

lab needs update. Airflow version 1 is not available and code is obsolete

Alexandre Q. · Reviewed أكثر من سنة ago

Manuel P. · Reviewed أكثر من سنة ago

El lab está desactualizado y no permite realizarlo correctamente

Luis G. · Reviewed أكثر من سنة ago

not working

Mikhail K. · Reviewed أكثر من سنة ago

Ahmad A. · Reviewed أكثر من سنة ago

lab is broken airflow 1.2 is no more

Diego M. · Reviewed أكثر من سنة ago

this command doesnt work so had to create composer via console: gcloud composer environments create ... eventually build fails because of Broken DAG: [/home/airflow/gcs/dags/data-pipeline-test.py] so can't progress the lab

Aliaksandr S. · Reviewed أكثر من سنة ago

Mikhail K. · Reviewed أكثر من سنة ago

Cloud Shell not opening

Brindha R. · Reviewed أكثر من سنة ago

09Serverless Data Processing with Dataflow: OperationsServerless Data Processing with Dataflow: Operations - startup command for composer is deprecated... needed to run: gcloud composer environments create $COMPOSER_ENV_NAME     --location $COMPOSER_REGION     --image-version composer-3-airflow-2.9 .1 Create the build and test pipeline Failed: BUILD FAILURE: Build step failure: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1ERROR: (gcloud.builds.submit) build f381c4f9-1e9a-482c-99a9-870ca434e4e3 completed with status "FAILURE" Had to manually rerun the script that fills in the environ variables for composer template (it was empty after running the script as directed) tried fixing code but ran out of time on lab. Fix your code and lab.

Nevin A. · Reviewed أكثر من سنة ago

Lab is not working. Giving cloud composer and airflow version error

Ashish N. · Reviewed أكثر من سنة ago