Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

Jose A. · Reviewed 12 ay ago

this is the worst lab tutorial in the Data Engineer learning path. the sample commands mentioned are obsolote. the image version identified in the command is causing error. when the image version is replaced with a newer one, which is offered as a solution alternative in the error message, the DAG is never building and failing. In addition, Google must revisit its decision about using AirFlow. I rated as one star, since I couldnt make it zero.

Utku G. · Reviewed 12 ay ago

I coudn't continue with the lab due to the error: gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15

Jose I. R. · Reviewed 12 ay ago

zhe90 G. · Reviewed 12 ay ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed 12 ay ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed 12 ay ago

Cloud Composer 1 in post-maintenance : Lab cannot be done : "Cloud Composer 1 is in the post-maintenance mode. Google does not release any further updates to Cloud Composer 1, including new versions of Airflow, bugfixes, and security updates. We recommend planning migration to Cloud Composer 2."

Julien B. · Reviewed 12 ay ago

Composer Outdated

Makawatt N. · Reviewed 12 ay ago

janarthanam j. · Reviewed 12 ay ago

Composer Outdated

Makawatt N. · Reviewed 12 ay ago

Andrii P. · Reviewed yaklaşık 1 yıl ago

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Reviewed yaklaşık 1 yıl ago

Janakiram C. · Reviewed yaklaşık 1 yıl ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3]. 이런 오류가 계속 나와서 실습을 진행 못해요...

지섭 소. · Reviewed yaklaşık 1 yıl ago

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Reviewed yaklaşık 1 yıl ago

Outdated code, please fix it.

pierre emmanuel m. · Reviewed yaklaşık 1 yıl ago

JORGE ALEJANDRO C. · Reviewed yaklaşık 1 yıl ago

task 2 image version noted for composer is not supported

Graham B. · Reviewed yaklaşık 1 yıl ago

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Reviewed yaklaşık 1 yıl ago

Cloud Composer environment not able to be set up

Andrew P. · Reviewed yaklaşık 1 yıl ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Reviewed yaklaşık 1 yıl ago

the build dont work

Jose Javier G. · Reviewed yaklaşık 1 yıl ago

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Reviewed yaklaşık 1 yıl ago

Manuel P. · Reviewed yaklaşık 1 yıl ago

Manuel P. · Reviewed yaklaşık 1 yıl ago