Serverless Data Processing with Dataflow - CI/CD with Dataflow Rezensionen

this is the worst lab tutorial in the Data Engineer learning path. the sample commands mentioned are obsolote. the image version identified in the command is causing error. when the image version is replaced with a newer one, which is offered as a solution alternative in the error message, the DAG is never building and failing. In addition, Google must revisit its decision about using AirFlow. I rated as one star, since I couldnt make it zero.

Utku G. · Vor 12 Monate überprüft

I coudn't continue with the lab due to the error: gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15

Jose I. R. · Vor 12 Monate überprüft

zhe90 G. · Vor 12 Monate überprüft

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Vor 12 Monate überprüft

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Vor 12 Monate überprüft

Cloud Composer 1 in post-maintenance : Lab cannot be done : "Cloud Composer 1 is in the post-maintenance mode. Google does not release any further updates to Cloud Composer 1, including new versions of Airflow, bugfixes, and security updates. We recommend planning migration to Cloud Composer 2."

Julien B. · Vor 12 Monate überprüft

Composer Outdated

Makawatt N. · Vor 12 Monate überprüft

janarthanam j. · Vor 12 Monate überprüft

Composer Outdated

Makawatt N. · Vor 12 Monate überprüft

Andrii P. · Vor 12 Monate überprüft

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Vor 12 Monate überprüft

Janakiram C. · Vor 12 Monate überprüft

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3]. 이런 오류가 계속 나와서 실습을 진행 못해요...

지섭 소. · Vor 12 Monate überprüft

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Vor 12 Monate überprüft

Outdated code, please fix it.

pierre emmanuel m. · Vor 12 Monate überprüft

JORGE ALEJANDRO C. · Vor etwa ein Jahr überprüft

task 2 image version noted for composer is not supported

Graham B. · Vor etwa ein Jahr überprüft

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Vor etwa ein Jahr überprüft

Cloud Composer environment not able to be set up

Andrew P. · Vor etwa ein Jahr überprüft

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Vor etwa ein Jahr überprüft

the build dont work

Jose Javier G. · Vor etwa ein Jahr überprüft

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Vor etwa ein Jahr überprüft

Manuel P. · Vor etwa ein Jahr überprüft

Manuel P. · Vor etwa ein Jahr überprüft

Kevin M. · Vor etwa ein Jahr überprüft