Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

Roberto P. · Reviewed about 4 years ago

set_env.sh script does not work so the whole lab could not be completed

Jakub B. · Reviewed about 4 years ago

Nick B. · Reviewed about 4 years ago

Pablo V. · Reviewed about 4 years ago

Febin W. · Reviewed about 4 years ago

Bogdan G. · Reviewed about 4 years ago

Bogdan G. · Reviewed about 4 years ago

Vladimir O. · Reviewed about 4 years ago

Cylia H. · Reviewed about 4 years ago

Rolf S. · Reviewed about 4 years ago

Cylia H. · Reviewed about 4 years ago

Rodrigo d. · Reviewed about 4 years ago

Rodrigo d. · Reviewed about 4 years ago

Volodymyr B. · Reviewed about 4 years ago

Serhii K. · Reviewed about 4 years ago

Please add to the initial setting: "Dataflow API" must be Enabled

Sergio B. · Reviewed about 4 years ago

In Task 2: Verify the build and test pipeline IN "BUILD DETAILS" PROBLEM WITH STEP 10: trigger-pipeline-execution (Build Details) composer environments run data-pipeline-composer --location us-central1 trigger_dag -- test_word_count --run_id=b5c9c7e1-5920-455a-949c-27afa48e0111 LOG Already have image (with digest): gcr.io/cloud-builders/gcloudkubeconfig entry generated for us-central1-data-pipeline-c-90e33297-gke.Executing within the following Kubernetes cluster namespace: composer-1-16-8-airflow-1-10-15-90e33297Unable to use a TTY - input is not a terminal or the right kind of fileThe 'trigger_dag' command is deprecated and removed in Airflow 2.0, please use 'dags trigger' insteadTraceback (most recent call last): File "/usr/local/bin/airflow", line 7, in <module> exec(compile(f.read(), __file__, 'exec')) File "/usr/local/lib/airflow/airflow/bin/airflow", line 37, in <module> args.func(args) File "/usr/local/lib/airflow/airflow/utils/cli.py", line 234, in wrapper func(args) File "/usr/local/lib/airflow/airflow/utils/cli.py", line 81, in wrapper return f(*args, **kwargs) File "/usr/local/lib/airflow/airflow/bin/cli.py", line 257, in trigger_dag execution_date=args.exec_date) File "/usr/local/lib/airflow/airflow/api/client/local_client.py", line 34, in trigger_dag execution_date=execution_date) File "/usr/local/lib/airflow/airflow/api/common/experimental/trigger_dag.py", line 120, in trigger_dag raise DagNotFound("Dag id {} not found in DagModel".format(dag_id))airflow.exceptions.DagNotFound: Dag id test_word_count not found in DagModelcommand terminated with exit code 1ERROR: (gcloud.composer.environments.run) kubectl returned non-zero status code.[2021-07-11 11:17:48,503] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg[2021-07-11 11:17:48,889] {configuration.py:732} INFO - Reading the config from /etc/airflow/airflow.cfg

Sergio B. · Reviewed about 4 years ago

test the triggers

Zhizhong Z. · Reviewed about 4 years ago

Ryan C. · Reviewed about 4 years ago

Tony M. · Reviewed about 4 years ago

Florian R. · Reviewed about 4 years ago

Arunav R. · Reviewed about 4 years ago

Kartik A. · Reviewed about 4 years ago

Excellent! I'm thinking that this could be a tad to dense (i'm thinking in the context of an ILT). Students with not enough experience might seem a bit overwhelmed while students with experience might ask in-depth questions. But in my own opinion, among the best GCP labs so far. Thanks!

Ionel M. · Reviewed about 4 years ago

Daryl E. · Reviewed over 4 years ago