Dataflow によるサーバーレス データ処理 – Dataflow を使用した CI / CD のレビュー

I wish I could give this zero stars. The first code snipped under Task 2 uses an outdated version. And troubleshooting the error leads to an automatic disconnect for unauthorized activity.

AI Needlestaq · 11ヶ月前にレビュー済み

Garcia Peter · 11ヶ月前にレビュー済み

Error al Crear un entorno de Cloud Composer: En Cloud Shell puse tal cual esta en el laboratorio y sale error student_02_4e3b1febb083@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-01-0322e0546bee)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.6-airflow-2.9.1, composer-2.8.6-airflow-2.7.3, composer-2.8.6-airflow-2.6.3]. student_02_4e3b1febb083@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-01-0322e0546bee)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-3-airflow-2.9.1 ERROR: (gcloud.composer.environments.create) Cannot specify --python-version with Composer 2.X or greater. student_02_4e3b1febb083@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-01-0322e0546bee)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 2 \ --image-version composer-3-airflow-2.9.1 ERROR: (gcloud.composer.environments.create) Cannot specify --python-version with Composer 2.X or greater.

De La Rosa Victor · 11ヶ月前にレビュー済み

Course instructions are not up to date. Gcloud commands fail and it's quite hard to complete the course.

Gutierrez Alan · 11ヶ月前にレビュー済み

Bendkhale Kaustubh · 11ヶ月前にレビュー済み

Step 9 failed in creating the build - I did rerun teh build it failed - with logs not giving enough information

Khanam Shabana · 11ヶ月前にレビュー済み

I am not able to create a pipeline, do to image version no longer available. Please help to update the command. I tried to use the newer version but always failed '9: wait-for-dag-deployed-on-composer' withi this error: 'ERROR: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1'

Widjaja Wiehan · 11ヶ月前にレビュー済み

many incorrect syntex

Kumar Rupesh · 11ヶ月前にレビュー済み

Sánchez Pascual · 11ヶ月前にレビュー済み

Parfenovich Dmitry · 11ヶ月前にレビュー済み

MARTINEZ CEDILLO CESAR ARMANDO · 11ヶ月前にレビュー済み

Can't build cloud composer ude to missing image-version Error. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.6-airflow-2.9.1, composer-2.8.6-airflow-2.7.3, composer-2.8.6-airflow-2.6.3].

Ou Oliver Ta-Jen · 11ヶ月前にレビュー済み

Step 9 failed in creating the build - I did rerun teh build it failed - with logs not giving enough information

Khanam Shabana · 11ヶ月前にレビュー済み

1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.9.1, composer-3-airflow-2.7.3, composer-2.8.6-airflow-2.9.1, composer-2.8.6-airflow-2.7.3, composer-2.8.6-airflow-2.6.3].

Verwijnen Johannes · 11ヶ月前にレビュー済み

The command in this lab is wrong: ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.7.3, composer-2.8.4-airflow-2.7.3, composer-2.8.4-airflow-2.6.3]. Update July 21, 2024: I have managed to complete the lab, but I had to fix many errors, which I mention below along with their solutions: - Install the latest version of compose: gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --image-version composer-3-airflow-2.7.3 - Update the file workflow-dag/data-pipeline-test.py at line 110 publish_task = PubSubPublishMessageOperator … Change project=project to project_id=project - In the file wait_for_dag_deployed.sh adjust the command according to version 3 of composer: gcloud composer environments run data-pipeline-composer --location us-central1 dags list -- -o plain

Solis Rengifo Jesus Francisco · 11ヶ月前にレビュー済み

doesnt work

Godfrey Lawrence · 11ヶ月前にレビュー済み

Dalbehera Bhavna · 11ヶ月前にレビュー済み

update the lab, can't be finish

enhaa Dragon · 11ヶ月前にレビュー済み

Skaria Sandra · 11ヶ月前にレビュー済み

Hi I am not able to perform the Serverless Data Processing with Dataflow - CI/CD with Dataflow LAB When creating the Cloud composer environment: "Create a Cloud Composer environment In Cloud Shell, run the following to create a Cloud Composer environment: gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15" " I am getting this error: ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-3-airflow-2.7.3, composer-2.8.5-airflow-2.7.3, composer-2.8.5-airflow-2.6.3]. I manged to create it by running this command: cloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --image-version composer-3-airflow-2.7.3 Issue is that then is impossible to do Task 5. Creating Cloud Build pipelines Buliding always fails in step 9, I tried several times and re did the lab getting the same reustls Can you please fix this and let me know how to proceed? Thanks Maximo

Corral San Martin Maximo · 11ヶ月前にレビュー済み

Mahammad Rafi · 11ヶ月前にレビュー済み

this is the worst lab i have practice. you can't even finish it, composer version is deprecated.

Jiménez Flores Claudio · 11ヶ月前にレビュー済み

mao manjing · 11ヶ月前にレビュー済み

CRUZ RIVERA JORGE ALEJANDRO · 11ヶ月前にレビュー済み

Composer env couldn't be created. I have tried to change several parameters, with no success

Dranga Cristi · 11ヶ月前にレビュー済み