Serverless Data Processing with Dataflow - CI/CD with Dataflow Ulasan

this is the worst lab tutorial in the Data Engineer learning path. the sample commands mentioned are obsolote. the image version identified in the command is causing error. when the image version is replaced with a newer one, which is offered as a solution alternative in the error message, the DAG is never building and failing. In addition, Google must revisit its decision about using AirFlow. I rated as one star, since I couldnt make it zero.

Utku G. · Diulas 12 bulan lalu

I coudn't continue with the lab due to the error: gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15

Jose I. R. · Diulas 12 bulan lalu

zhe90 G. · Diulas 12 bulan lalu

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Diulas 12 bulan lalu

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Diulas 12 bulan lalu

Cloud Composer 1 in post-maintenance : Lab cannot be done : "Cloud Composer 1 is in the post-maintenance mode. Google does not release any further updates to Cloud Composer 1, including new versions of Airflow, bugfixes, and security updates. We recommend planning migration to Cloud Composer 2."

Julien B. · Diulas 12 bulan lalu

Composer Outdated

Makawatt N. · Diulas 12 bulan lalu

janarthanam j. · Diulas 12 bulan lalu

Composer Outdated

Makawatt N. · Diulas 12 bulan lalu

Andrii P. · Diulas 12 bulan lalu

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Diulas 12 bulan lalu

Janakiram C. · Diulas 12 bulan lalu

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3]. 이런 오류가 계속 나와서 실습을 진행 못해요...

지섭 소. · Diulas 12 bulan lalu

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Diulas 12 bulan lalu

Outdated code, please fix it.

pierre emmanuel m. · Diulas 12 bulan lalu

JORGE ALEJANDRO C. · Diulas 12 bulan lalu

task 2 image version noted for composer is not supported

Graham B. · Diulas sekitar 1 tahun lalu

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Diulas sekitar 1 tahun lalu

Cloud Composer environment not able to be set up

Andrew P. · Diulas sekitar 1 tahun lalu

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Diulas sekitar 1 tahun lalu

the build dont work

Jose Javier G. · Diulas sekitar 1 tahun lalu

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Diulas sekitar 1 tahun lalu

Manuel P. · Diulas sekitar 1 tahun lalu

Manuel P. · Diulas sekitar 1 tahun lalu

Kevin M. · Diulas sekitar 1 tahun lalu