Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

Jose A. · Reviewed 12 شهر ago

this is the worst lab tutorial in the Data Engineer learning path. the sample commands mentioned are obsolote. the image version identified in the command is causing error. when the image version is replaced with a newer one, which is offered as a solution alternative in the error message, the DAG is never building and failing. In addition, Google must revisit its decision about using AirFlow. I rated as one star, since I couldnt make it zero.

Utku G. · Reviewed 12 شهر ago

I coudn't continue with the lab due to the error: gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15

Jose I. R. · Reviewed 12 شهر ago

zhe90 G. · Reviewed 12 شهر ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed 12 شهر ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed 12 شهر ago

Cloud Composer 1 in post-maintenance : Lab cannot be done : "Cloud Composer 1 is in the post-maintenance mode. Google does not release any further updates to Cloud Composer 1, including new versions of Airflow, bugfixes, and security updates. We recommend planning migration to Cloud Composer 2."

Julien B. · Reviewed 12 شهر ago

Composer Outdated

Makawatt N. · Reviewed 12 شهر ago

janarthanam j. · Reviewed 12 شهر ago

Composer Outdated

Makawatt N. · Reviewed 12 شهر ago

Andrii P. · Reviewed 12 شهر ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed 12 شهر ago

Janakiram C. · Reviewed 12 شهر ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3]. 이런 오류가 계속 나와서 실습을 진행 못해요...

지섭 소. · Reviewed 12 شهر ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed حوالي سنة ago

Outdated code, please fix it.

pierre emmanuel m. · Reviewed حوالي سنة ago

JORGE ALEJANDRO C. · Reviewed حوالي سنة ago

task 2 image version noted for composer is not supported

Graham B. · Reviewed حوالي سنة ago

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Reviewed حوالي سنة ago

Cloud Composer environment not able to be set up

Andrew P. · Reviewed حوالي سنة ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Reviewed حوالي سنة ago

the build dont work

Jose Javier G. · Reviewed حوالي سنة ago

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Reviewed حوالي سنة ago

Manuel P. · Reviewed حوالي سنة ago

Manuel P. · Reviewed حوالي سنة ago