Serverless Data Processing with Dataflow - CI/CD with Dataflow avis

this is the worst lab tutorial in the Data Engineer learning path. the sample commands mentioned are obsolote. the image version identified in the command is causing error. when the image version is replaced with a newer one, which is offered as a solution alternative in the error message, the DAG is never building and failing. In addition, Google must revisit its decision about using AirFlow. I rated as one star, since I couldnt make it zero.

Utku G. · Examiné il y a 12 mois

I coudn't continue with the lab due to the error: gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15

Jose I. R. · Examiné il y a 12 mois

zhe90 G. · Examiné il y a 12 mois

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Examiné il y a 12 mois

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Examiné il y a 12 mois

Cloud Composer 1 in post-maintenance : Lab cannot be done : "Cloud Composer 1 is in the post-maintenance mode. Google does not release any further updates to Cloud Composer 1, including new versions of Airflow, bugfixes, and security updates. We recommend planning migration to Cloud Composer 2."

Julien B. · Examiné il y a 12 mois

Composer Outdated

Makawatt N. · Examiné il y a 12 mois

janarthanam j. · Examiné il y a 12 mois

Composer Outdated

Makawatt N. · Examiné il y a 12 mois

Andrii P. · Examiné il y a 12 mois

It automatically closeing the lab before the time limit i'm not able to complete this lab due to this issue please help me to resolve this issue

Gajendra B. · Examiné il y a 12 mois

Janakiram C. · Examiné il y a 12 mois

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3]. 이런 오류가 계속 나와서 실습을 진행 못해요...

지섭 소. · Examiné il y a 12 mois

Cloud Composer 1 in post-maintenance : Lab cannot be done

Julien B. · Examiné il y a 12 mois

Outdated code, please fix it.

pierre emmanuel m. · Examiné il y a environ un an

JORGE ALEJANDRO C. · Examiné il y a environ un an

task 2 image version noted for composer is not supported

Graham B. · Examiné il y a environ un an

It's no longer possible to create a cloud composer environment with the specified version in the tutorial. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.7-airflow-2.9.1, composer-2.8.7-airflow-2.7.3, composer-2.8.7-airflow-2.6.3].

Mateusz W. · Examiné il y a environ un an

Cloud Composer environment not able to be set up

Andrew P. · Examiné il y a environ un an

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-03-b02349cdda95'}

Jose Javier G. · Examiné il y a environ un an

the build dont work

Jose Javier G. · Examiné il y a environ un an

Cloud Shell not opening. Cloud Composer Environment Set Up error

Brindha R. · Examiné il y a environ un an

Manuel P. · Examiné il y a environ un an

Manuel P. · Examiné il y a environ un an

Kevin M. · Examiné il y a environ un an