Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Reviewed 1 yıldan fazla ago

Cloud Composer environment not able to be set up

Andrew P. · Reviewed 1 yıldan fazla ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Reviewed 1 yıldan fazla ago

the build dont work

Jose Javier G. · Reviewed 1 yıldan fazla ago

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Reviewed 1 yıldan fazla ago

Manuel P. · Reviewed 1 yıldan fazla ago

Manuel P. · Reviewed 1 yıldan fazla ago

Kevin M. · Reviewed 1 yıldan fazla ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed 1 yıldan fazla ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed 1 yıldan fazla ago

Armin M. · Reviewed 1 yıldan fazla ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.8.1-airflow-2.7.3, composer-2.8.1-airflow-2.6.3].

Ike D. · Reviewed 1 yıldan fazla ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed 1 yıldan fazla ago

lab needs update. Airflow version 1 is not available and code is obsolete

Alexandre Q. · Reviewed 1 yıldan fazla ago

Manuel P. · Reviewed 1 yıldan fazla ago

El lab está desactualizado y no permite realizarlo correctamente

Luis G. · Reviewed 1 yıldan fazla ago

not working

Mikhail K. · Reviewed 1 yıldan fazla ago

Ahmad A. · Reviewed 1 yıldan fazla ago

lab is broken airflow 1.2 is no more

Diego M. · Reviewed 1 yıldan fazla ago

this command doesnt work so had to create composer via console: gcloud composer environments create ... eventually build fails because of Broken DAG: [/home/airflow/gcs/dags/data-pipeline-test.py] so can't progress the lab

Aliaksandr S. · Reviewed 1 yıldan fazla ago

Mikhail K. · Reviewed 1 yıldan fazla ago

Cloud Shell not opening

Brindha R. · Reviewed 1 yıldan fazla ago

09Serverless Data Processing with Dataflow: OperationsServerless Data Processing with Dataflow: Operations - startup command for composer is deprecated... needed to run: gcloud composer environments create $COMPOSER_ENV_NAME     --location $COMPOSER_REGION     --image-version composer-3-airflow-2.9 .1 Create the build and test pipeline Failed: BUILD FAILURE: Build step failure: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1ERROR: (gcloud.builds.submit) build f381c4f9-1e9a-482c-99a9-870ca434e4e3 completed with status "FAILURE" Had to manually rerun the script that fills in the environ variables for composer template (it was empty after running the script as directed) tried fixing code but ran out of time on lab. Fix your code and lab.

Nevin A. · Reviewed 1 yıldan fazla ago

Lab is not working. Giving cloud composer and airflow version error

Ashish N. · Reviewed 1 yıldan fazla ago

I cannot complete this lab

Victor Hugo V. · Reviewed 1 yıldan fazla ago