리뷰 Serverless Data Processing with Dataflow - CI/CD with Dataflow개

Agustin B. · 8개월 전에 리뷰됨

Terence S. · 8개월 전에 리뷰됨

Mauro R. · 8개월 전에 리뷰됨

Max M. · 8개월 전에 리뷰됨

Riccardo M. · 8개월 전에 리뷰됨

Satish C. · 8개월 전에 리뷰됨

First of all, I'm going though the Apache Beam course and for some reason Apache Airflow appeared. Also the lab is terrible, about 30 minutes I just waited. No tasks, no new knowledge, just copy-pasting. One of the worst labs I had on the portal.

Maksim T. · 8개월 전에 리뷰됨

AjithKumar P. · 8개월 전에 리뷰됨

Lab desatualizado

Felipe F. · 8개월 전에 리뷰됨

AjithKumar P. · 8개월 전에 리뷰됨

Ravindra b. · 8개월 전에 리뷰됨

Rushikesh N. · 8개월 전에 리뷰됨

needs time to study it but interesting complete CICD

Andreas K. · 8개월 전에 리뷰됨

Vishnu M. · 8개월 전에 리뷰됨

Riccardo M. · 8개월 전에 리뷰됨

too many errors making it impossible to complete in time. for instance, the image in the code does not exist. the DAG keeps failing, and more. I've now tried it two times, and it is impossible to complete.

Trym S. · 8개월 전에 리뷰됨

NA

Nenavath R. · 8개월 전에 리뷰됨

wordcount-run fails with error: [2024-12-15, 21:15:32 UTC] {beam.py:119} WARNING - WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://dataflow.googleapis.com/v1b3/projects/qwiklabs-gcp-01-caa5705744db/locations/us-central1/jobs. [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - Exception in thread "main" java.lang.RuntimeException: Failed to create a workflow job: (3c8e5c18af78a2a): 'us-central1' violates constraint 'constraints/gcp.resourceLocations' on the resource 'projects/qwiklabs-gcp-01-caa5705744db'. [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:972) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:186) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.examples.WordCount.runWordCount(WordCount.java:187) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.examples.WordCount.main(WordCount.java:193) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - { [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "code" : 400, [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "errors" : [ { [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "domain" : "global", [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "message" : "(3c8e5c18af78a2a): 'us-central1' violates constraint 'constraints/gcp.resourceLocations' on the resource 'projects/qwiklabs-gcp-01-caa5705744db'.", [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "reason" : "failedPrecondition" [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - } ], [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "message" : "(3c8e5c18af78a2a): 'us-central1' violates constraint 'constraints/gcp.resourceLocations' on the resource 'projects/qwiklabs-gcp-01-caa5705744db'.", [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - "status" : "FAILED_PRECONDITION" [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - } [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61) [2024-12-15, 21:15:33 UTC] {beam.py:119} WARNING - at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:958)

Marcelo B. · 8개월 전에 리뷰됨

Riccardo M. · 8개월 전에 리뷰됨

Sana K. · 8개월 전에 리뷰됨

NA

Nenavath R. · 8개월 전에 리뷰됨

Steven B. · 8개월 전에 리뷰됨

This had 2 blockers. The 2nd killed my 1st attempt. 1. Airflow version non-existent anymore, had to pick one from https://cloud.google.com/composer/docs/concepts/versioning/composer-versions instead. 2. (stage: watching Airflow DAGs) The default regions setup blows up during the first task. Says constraints/gcp.resourceLocations is violated, because f--k us-central1. The student can't adjust those permissions because they have no editor rights.

Anna E. · 8개월 전에 리뷰됨

Kamala Krishnan S. · 8개월 전에 리뷰됨

I've tried more than a dozen times. It always fails on the DAG run.

Flavio B. · 8개월 전에 리뷰됨