Processamento de dados sem servidor com o Dataflow: CI/CD no Dataflow avaliações

João P. · Revisado há about 3 years

Jatin L. · Revisado há about 3 years

Great

Thirumalai S. · Revisado há about 3 years

Gonzalo A. · Revisado há about 3 years

Felipe C. · Revisado há about 3 years

Cesar G. · Revisado há about 3 years

I got several errors despite following given steps student_00_4d80561dcf8a@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-01-e56d723f2352)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 2 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid python version: [2]. Python version may be either '3' or left empty. and later on starting build "6fb27bf1-d88e-4a8b-b708-eed0578518ef" FETCHSOURCE hint: Using 'master' as the name for the initial branch. This default branch name hint: is subject to change. To configure the initial branch name to use in all hint: of your new repositories, which will suppress this warning, call: hint: hint: git config --global init.defaultBranch <name> hint: hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and hint: 'development'. The just-created branch can be renamed via this command: hint: hint: git branch -m <name> Initialized empty Git repository in /workspace/.git/ From https://source.developers.google.com/p/qwiklabs-gcp-01-e56d723f2352/r/data-pipeline-source * branch 994f43df1be9bf9e697b19c56502a5eb783e063c -> FETCH_HEAD HEAD is now at 994f43d change in test files BUILD Starting Step #0 - "check-out-source-code" Step #0 - "check-out-source-code": Already have image (with digest): gcr.io/cloud-builders/git Step #0 - "check-out-source-code": Cloning into 'data-pipeline-source'... Finished Step #0 - "check-out-source-code" Starting Step #1 - "build-jar" Step #1 - "build-jar": Already have image (with digest): gcr.io/cloud-builders/mvn:3.5.0-jdk-8 Finished Step #1 - "build-jar" Starting Step #2 - "deploy-jar" Step #2 - "deploy-jar": Already have image (with digest): gcr.io/cloud-builders/gsutil Step #2 - "deploy-jar": BucketNotFoundException: 404 gs://project-composer-dataflow-source bucket does not exist. Finished Step #2 - "deploy-jar" ERROR ERROR: build step 2 "gcr.io/cloud-builders/gsutil" failed: step exited with non-zero status: 1

Omaira O. · Revisado há about 3 years

Georgios C. · Revisado há about 3 years

Arya K. · Revisado há about 3 years

Khushal P. · Revisado há about 3 years

Ramakoti K. · Revisado há about 3 years

Thanks

Alan Ignacio S. · Revisado há about 3 years

Khushal P. · Revisado há about 3 years

Fazil M. · Revisado há about 3 years

Nonitha V. · Revisado há about 3 years

To pass the lab successfully user needs to use the following commit: https://github.com/GoogleCloudPlatform/ci-cd-for-data-processing-workflow/commit/f900b51106a2189f7bc2dacffc9760952b0bd245

Andrei U. · Revisado há about 3 years

There is a problem to deploy DAG to Composer.

Andrei U. · Revisado há about 3 years

Cannot complete this lab because this error occurs In Task: Task 1: Create the build and test pipeline, the execution does not go beyond Step #9, logging the error message: Finished Step #9 - "wait-for-dag-deployed-on-composer" ERROR ERROR: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1

Vinícius R. · Revisado há about 3 years

Cannot complete this lab because this error occurs In Task: Task 1: Create the build and test pipeline, the execution does not go beyond Step #9, logging the error message: Finished Step #9 - "wait-for-dag-deployed-on-composer" ERROR ERROR: build step 9 "gcr.io/cloud-builders/gcloud" failed: step exited with non-zero status: 1

Vinícius R. · Revisado há about 3 years

Build fails unexpectedly. Not enough resources to get help on the issues.

Jatin L. · Revisado há about 3 years

The build pipeline is breaking at step 9. In airflow servers, we can see this erros on DAGS tab: Broken DAG: [/home/airflow/gcs/dags/data-pipeline-test.py] No module named providers.google.cloud.transfers.gcs_to_local . I don't know if it's missing the whole module, or maybe something changed but i don't know how to fix it

Renata E. · Revisado há about 3 years

Task 2 in Creating Cloud Build pipelines repeatedly fails, even though the previous step is marked as completed.

Anna B. · Revisado há about 3 years

Matheus S. · Revisado há about 3 years