Serverless Data Processing with Dataflow - CI/CD with Dataflow Reviews

Gabriela G. · Reviewed about 3 years ago

Pf4rR3R G. · Reviewed about 3 years ago

FABIAN A. · Reviewed about 3 years ago

Juan R. · Reviewed about 3 years ago

Swanand P. · Reviewed about 3 years ago

ISABEL P. · Reviewed about 3 years ago

Sri Lakshmipathi R. · Reviewed about 3 years ago

Juan L. · Reviewed about 3 years ago

Facundo V. · Reviewed about 3 years ago

unable to run cloud composer at step 2. How will I complete the lab when I can't even run the very first step as the error says try again later?

Techit K. · Reviewed about 3 years ago

Doesn't work

Nicolás Q. · Reviewed about 3 years ago

data-pipline-composer Build doesn't complete in 15 minutes It takes longer or fails but what does that mean? It did not complete even after 30 minutes, and the build had already failed 3 times... Execution of the command ended in failure student_03_f4c9967d291c@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-04-9a8c247344cc)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 Waiting for [projects/qwiklabs-gcp-04-9a8c247344cc/locations/us-central1/environments/data-pipeline-composer] to be created with [projects/qwiklabs-gcp-04-9a8c247344cc/locati ons/us-central1/operations/4e089d42-2a1b-4dbe-84fd-5856811a1679]...failed. ERROR: (gcloud.composer.environments.create) Error creating [projects/qwiklabs-gcp-04-9a8c247344cc/locations/us-central1/environments/data-pipeline-composer]: Operation [projects/qwiklabs-gcp-04-9a8c247344cc/locations/us-central1/operations/4e089d42-2a1b-4dbe-84fd-5856811a1679] failed: CREATE operation failed. Errors in: [Web server]; Error messages: Failed to deploy the Airflow web server. This might be a temporary issue. You can retry the operation later. If the issue persists, it might be caused by problems with permissions or network configuration. For more information, see https://cloud.google.com/composer/docs/troubleshooting-environment-creation. An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2022-11-25T10:08:29.744Z310160.in.0: Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section. student_03_f4c9967d291c@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-04-9a8c247344cc)$ (qwiklabs-gcp-02-03e22725a907)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 Waiting for [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/environments/data-pipeline-composer] to be created with [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/o perations/02396047-249e-41a3-b80a-4f4e8d974c6b]...failed. ERROR: (gcloud.composer.environments.create) Error creating [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/environments/data-pipeline-composer]: Operation [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/operations/02396047-249e-41a3-b80a-4f4e8d974c6b] failed: CREATE operation failed. Errors in: [Web server]; Error messages: Failed to deploy the Airflow web server. This might be a temporary issue. You can retry the operation later. If the issue persists, it might be caused by problems with permissions or network configuration. For more information, see https://cloud.google.com/composer/docs/troubleshooting-environment-creation. An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2022-11-27T01:24:45.468Z54794.jc.1: Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section. student_03_09c9de2485de@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-02-03e22725a907)$ -- (qwiklabs-gcp-02-03e22725a907)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 Waiting for [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/environments/data-pipeline-composer] to be created with [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/o perations/67734c7a-3685-415a-8b74-a5b3eaf51f09]...failed. ERROR: (gcloud.composer.environments.create) Error creating [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/environments/data-pipeline-composer]: Operation [projects/qwiklabs-gcp-02-03e22725a907/locations/us-central1/operations/67734c7a-3685-415a-8b74-a5b3eaf51f09] failed: CREATE operation failed. Errors in: [Web server]; Error messages: Failed to deploy the Airflow web server. This might be a temporary issue. You can retry the operation later. If the issue persists, it might be caused by problems with permissions or network configuration. For more information, see https://cloud.google.com/composer/docs/troubleshooting-environment-creation. An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2022-11-27T02:08:28.283Z54901.jf.2: Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section. student_03_09c9de2485de@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-02-03e22725a907)$ -- CREATE operation on this environment failed 10 minutes ago with the following error message: CREATE operation failed. Errors in: [Web server]; Error messages: Failed to deploy the Airflow web server. This might be a temporary issue. You can retry the operation later. If the issue persists, it might be caused by problems with permissions or network configuration. For more information, see https://cloud.google.com/composer/docs/troubleshooting-environment-creation. An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2022-11-27T02:08:28.283Z54901.jf.2: Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section.

Kano T. · Reviewed about 3 years ago

I am not able to figure out to assign in order for the composer to start without any persmission related issues

Ali M. · Reviewed about 3 years ago

environment issue

Ljupco G. · Reviewed about 3 years ago

ISABEL P. · Reviewed about 3 years ago

Cloud composer did not start even after 40 minutes

Nataraja G. · Reviewed about 3 years ago

Environment provisioning failed.

Corey C. · Reviewed about 3 years ago

Cloud composer did not start even after 30 minutes.

Nataraja G. · Reviewed about 3 years ago

Vijayanand P. · Reviewed about 3 years ago

The environment failed to spin up...

Jacob T. · Reviewed about 3 years ago

data-pipline-composer Build doesn't complete in 15 minutes It takes longer or fails but what does that mean? It did not complete even after 30 minutes, and the build had already failed 3 times... Execution of the command ended in failure student_03_f4c9967d291c@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-04-9a8c247344cc)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 Waiting for [projects/qwiklabs-gcp-04-9a8c247344cc/locations/us-central1/environments/data-pipeline-composer] to be created with [projects/qwiklabs-gcp-04-9a8c247344cc/locati ons/us-central1/operations/4e089d42-2a1b-4dbe-84fd-5856811a1679]...failed. ERROR: (gcloud.composer.environments.create) Error creating [projects/qwiklabs-gcp-04-9a8c247344cc/locations/us-central1/environments/data-pipeline-composer]: Operation [projects/qwiklabs-gcp-04-9a8c247344cc/locations/us-central1/operations/4e089d42-2a1b-4dbe-84fd-5856811a1679] failed: CREATE operation failed. Errors in: [Web server]; Error messages: Failed to deploy the Airflow web server. This might be a temporary issue. You can retry the operation later. If the issue persists, it might be caused by problems with permissions or network configuration. For more information, see https://cloud.google.com/composer/docs/troubleshooting-environment-creation. An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2022-11-25T10:08:29.744Z310160.in.0: Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section. student_03_f4c9967d291c@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-04-9a8c247344cc)$

Kano T. · Reviewed about 3 years ago

Juan R. · Reviewed about 3 years ago

Can't create Composer environment as it times out!

Eilidh M. · Reviewed about 3 years ago