Dataflow によるサーバーレス データ処理 – Dataflow を使用した CI / CD のレビュー

Pedro de Bragança Alves João · 約3年前にレビュー済み

Laxman Gharat Jatin · 約3年前にレビュー済み

Great

S Thirumalai · 約3年前にレビュー済み

S Thirumalai · 約3年前にレビュー済み

Arce Gonzalo · 約3年前にレビュー済み

Chagas de Souza Felipe · 約3年前にレビュー済み

Granjeno Cesar · 約3年前にレビュー済み

I got several errors despite following given steps student_00_4d80561dcf8a@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-01-e56d723f2352)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 2 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid python version: [2]. Python version may be either '3' or left empty. and later on starting build "6fb27bf1-d88e-4a8b-b708-eed0578518ef" FETCHSOURCE hint: Using 'master' as the name for the initial branch. This default branch name hint: is subject to change. To configure the initial branch name to use in all hint: of your new repositories, which will suppress this warning, call: hint: hint: git config --global init.defaultBranch <name> hint: hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and hint: 'development'. The just-created branch can be renamed via this command: hint: hint: git branch -m <name> Initialized empty Git repository in /workspace/.git/ From https://source.developers.google.com/p/qwiklabs-gcp-01-e56d723f2352/r/data-pipeline-source * branch 994f43df1be9bf9e697b19c56502a5eb783e063c -> FETCH_HEAD HEAD is now at 994f43d change in test files BUILD Starting Step #0 - "check-out-source-code" Step #0 - "check-out-source-code": Already have image (with digest): gcr.io/cloud-builders/git Step #0 - "check-out-source-code": Cloning into 'data-pipeline-source'... Finished Step #0 - "check-out-source-code" Starting Step #1 - "build-jar" Step #1 - "build-jar": Already have image (with digest): gcr.io/cloud-builders/mvn:3.5.0-jdk-8 Finished Step #1 - "build-jar" Starting Step #2 - "deploy-jar" Step #2 - "deploy-jar": Already have image (with digest): gcr.io/cloud-builders/gsutil Step #2 - "deploy-jar": BucketNotFoundException: 404 gs://project-composer-dataflow-source bucket does not exist. Finished Step #2 - "deploy-jar" ERROR ERROR: build step 2 "gcr.io/cloud-builders/gsutil" failed: step exited with non-zero status: 1

O'Hallorans Omaira · 約3年前にレビュー済み

Charatsaris Georgios · 約3年前にレビュー済み

Kumari Arya · 約3年前にレビュー済み

Parmar Khushal · 約3年前にレビュー済み

Parmar Khushal · 約3年前にレビュー済み

Kunam Ramakoti · 約3年前にレビュー済み

Thanks

Sepúlveda Rodríguez Alan Ignacio · 約3年前にレビュー済み

Parmar Khushal · 約3年前にレビュー済み

Mouhamad Fazil · 約3年前にレビュー済み

Vampati Nonitha · 約3年前にレビュー済み

To pass the lab successfully user needs to use the following commit: https://github.com/GoogleCloudPlatform/ci-cd-for-data-processing-workflow/commit/f900b51106a2189f7bc2dacffc9760952b0bd245

Uhlik Andrei · 約3年前にレビュー済み

There is a problem to deploy DAG to Composer.

Uhlik Andrei · 約3年前にレビュー済み

Cannot complete this lab because this error occurs In Task: Task 1: Create the build and test pipeline, the execution does not go beyond Step #9, logging the error message: Finished Step #9 - "wait-for-dag-deployed-on-composer" ERROR ERROR: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1

Rasteiro Vinícius · 約3年前にレビュー済み

Cannot complete this lab because this error occurs In Task: Task 1: Create the build and test pipeline, the execution does not go beyond Step #9, logging the error message: Finished Step #9 - "wait-for-dag-deployed-on-composer" ERROR ERROR: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1

Rasteiro Vinícius · 約3年前にレビュー済み

Build fails unexpectedly. Not enough resources to get help on the issues.

Laxman Gharat Jatin · 約3年前にレビュー済み

The build pipeline is breaking at step 9. In airflow servers, we can see this erros on DAGS tab: Broken DAG: [/home/airflow/gcs/dags/data-pipeline-test.py] No module named providers.google.cloud.transfers.gcs_to_local . I don't know if it's missing the whole module, or maybe something changed but i don't know how to fix it

Esperança Renata · 約3年前にレビュー済み

Task 2 in Creating Cloud Build pipelines repeatedly fails, even though the previous step is marked as completed.

Bondarieva Anna · 約3年前にレビュー済み

Silva Matheus · 約3年前にレビュー済み