Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

It is impossiblee to create the cloud composer enviroment(task2)

Monika K. · Reviewed בערך שנה אחת ago

Ahmad A. · Reviewed בערך שנה אחת ago

BUGGGG

Muhtarom A. · Reviewed בערך שנה אחת ago

Instruction for Cloud Composer environment creation is wrong. At Task5, the following error message appears. Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 437, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 794, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-04-185741e67'}

Yuri F. · Reviewed בערך שנה אחת ago

This lab does not work, the first code: gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.7.3, composer-2.8.2-airflow-2.7.3, composer-2.8.2-airflow-2.6.3]. student_03_bf6a99f5ecf3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-00-62eb828b9159)$ I've tried multiple things, only one worked and then I was kicked out of the lab for not following instructions. Please fix! Update 7/16/2024 - this lab still does not work. The same error was receive. I was advised by Skills Boost support that the error was resolved.

Jenna R. · Reviewed בערך שנה אחת ago

Not working in gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15

Alessandro T. · Reviewed בערך שנה אחת ago

issue with ressources initialisation

Tanguy S. · Reviewed בערך שנה אחת ago

Cloud Composer version no longer supported. It has been discontinued.

Peter V. · Reviewed בערך שנה אחת ago

Was not able to progress as the airflow composer version is deprecated picked a different version the env did not get created

Shabana K. · Reviewed בערך שנה אחת ago

... bugs

Ulan S. · Reviewed בערך שנה אחת ago

Valentin G. · Reviewed בערך שנה אחת ago

gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 this command is not working

Antonin H. · Reviewed בערך שנה אחת ago

Full of bugs

Eduard Nicolae P. · Reviewed בערך שנה אחת ago

Vanya M. · Reviewed בערך שנה אחת ago

the lab code had few bugs which I needed to fix, but overall it was a great challenge

Iman E. · Reviewed בערך שנה אחת ago

Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 429, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 788, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-01-9f8c1692d8a8'}

Alex W. · Reviewed בערך שנה אחת ago

Muruganandham V. · Reviewed בערך שנה אחת ago

Carlos A. · Reviewed בערך שנה אחת ago

The command in this lab is wrong: ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.7.3, composer-2.8.4-airflow-2.7.3, composer-2.8.4-airflow-2.6.3].

Jesus Francisco S. · Reviewed בערך שנה אחת ago

Zachary M. · Reviewed בערך שנה אחת ago

The command in this lab is wrong

Jesus Francisco S. · Reviewed בערך שנה אחת ago

Carlos A. · Reviewed בערך שנה אחת ago

Valentin G. · Reviewed בערך שנה אחת ago

Nayan P. · Reviewed בערך שנה אחת ago

Nayan P. · Reviewed בערך שנה אחת ago