Serverless Data Processing with Dataflow - CI/CD with Dataflow Rezensionen
4545 Rezensionen
This lab is a complete mess.
Benjamin M. · Vor mehr als ein Jahr überprüft
This lab is a complete mess.
Benjamin M. · Vor mehr als ein Jahr überprüft
Łukasz S. · Vor mehr als ein Jahr überprüft
Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 429, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 788, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-01-9f8c1692d8a8'}
Alex W. · Vor mehr als ein Jahr überprüft
This lab is out of date
Andre L. · Vor mehr als ein Jahr überprüft
Impossible to finish this lab because version of environments do not supports anymore
Oleh A. · Vor mehr als ein Jahr überprüft
many issues in labs
Mayuri Raosaheb H. · Vor mehr als ein Jahr überprüft
Kept failing to build
Brendan J. · Vor mehr als ein Jahr überprüft
Broken DAG (dags/data-pipeline-test.py): Traceback (most recent call last): File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 429, in apply_defaults result = func(self, **kwargs, default_args=default_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 788, in __init__ raise AirflowException( airflow.exceptions.AirflowException: Invalid arguments were passed to PubSubPublishMessageOperator (task_id: publish_test_complete). Invalid arguments were: **kwargs: {'project': 'qwiklabs-gcp-01-9f8c1692d8a8'}
Alex W. · Vor mehr als ein Jahr überprüft
Alex W. · Vor mehr als ein Jahr überprüft
Miłosz P. · Vor mehr als ein Jahr überprüft
Murali P. · Vor mehr als ein Jahr überprüft
THIS IS JOKE!
Miłosz P. · Vor mehr als ein Jahr überprüft
Steps do not work. I got warned and lab ended for trying to find a way to workaround the versioning problems
Dimitrios L. · Vor mehr als ein Jahr überprüft
This lab is a complete mess.
Benjamin M. · Vor mehr als ein Jahr überprüft
Suzanne V. · Vor mehr als ein Jahr überprüft
J. Abraham F. · Vor mehr als ein Jahr überprüft
Alex W. · Vor mehr als ein Jahr überprüft
sreehari R. · Vor mehr als ein Jahr überprüft
s.blok1@chello.nl B. · Vor mehr als ein Jahr überprüft
levi a. · Vor mehr als ein Jahr überprüft
ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.12-airflow-2.3.4' derived based on your input: 'composer-1.20.12-airflow-2.3.4'. Currently suggested new environment image versions are: [composer-2.6.4-airflow-2.6.3, composer-2.6.4-airflow-2.5.3]. Cloud Composer 1 will reach the end of support on March 25, 2024. Creation of new Cloud Composer 1 environments is only possible if the project already contains a Composer 1 environment in the same location. We recommend migration to Cloud Composer 2. ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Configuring node location is not supported for Cloud Composer environments in versions 2.0.0 and newer.
Serhii Z. · Vor mehr als ein Jahr überprüft
a lot of bugs
Umang M. · Vor mehr als ein Jahr überprüft
Lab out of date: Multiple errors due to composer v1 not v2: cd ~/ci-cd-for-data-processing-workflow/env-setup chmod +x set_composer_variables.sh ./set_composer_variables.sh Welcome to Cloud Shell! Type "help" to get started. Your Cloud Platform project in this session is set to qwiklabs-gcp-03-9b7a5801b2d0. Use “gcloud config set project [PROJECT_ID]” to change to a different project. student_00_ea9e4e2b2fa3@cloudshell:~ (qwiklabs-gcp-03-9b7a5801b2d0)$ git clone https://github.com/GoogleCloudPlatform/ci-cd-for-data-processing-workflow.git Cloning into 'ci-cd-for-data-processing-workflow'... remote: Enumerating objects: 172, done. remote: Counting objects: 100% (100/100), done. remote: Compressing objects: 100% (60/60), done. remote: Total 172 (delta 47), reused 68 (delta 33), pack-reused 72 Receiving objects: 100% (172/172), 55.99 KiB | 2.80 MiB/s, done. Resolving deltas: 100% (66/66), done. student_00_ea9e4e2b2fa3@cloudshell:~ (qwiklabs-gcp-03-9b7a5801b2d0)$ cd ~/ci-cd-for-data-processing-workflow/env-setup source set_env.sh student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME \ --location $COMPOSER_REGION \ --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.6.5-airflow-2.7.3, composer-2.6.5-airflow-2.6.3, composer-2.6.5-airflow-2.5.3]. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.6.5-airflow-2.7.3, composer-2.6.5-airflow-2.6.3, composer-2.6.5-airflow-2.5.3]. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.6.5-airflow-2.7.3, composer-2.6.5-airflow-2.6.3, composer-2.6.5-airflow-2.5.3]. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-2.6.5-airflow-2.7.3 ERROR: (gcloud.composer.environments.create) Cannot specify --python-version with Composer 2.X or greater. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-2.6.5-airflow-2.7.3^C --zone $COMPOSER_ZONE_ID \ --python-version 3 \ --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.6.5-airflow-2.7.3, composer-2.6.5-airflow-2.6.3, composer-2.6.5-airflow-2.5.3]. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.6.5-airflow-2.7.3, composer-2.6.5-airflow-2.6.3, composer-2.6.5-airflow-2.5.3]. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-1.20.8-airflow-1.10.15ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Invalid image version: 'composer-1.20.8-airflow-1.10.15' derived based on your input: 'composer-1.20.8-airflow-1.10.15'. Currently suggested new environment image versions are: [composer-2.6.5-airflow-2.7.3, composer-2.6.5-airflow-2.6.3, composer-2.6.5-airflow-2.5.3]. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-2.6.5-airflow-2.7.3 ERROR: (gcloud.composer.environments.create) Cannot specify --python-version with Composer 2.X or greater. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --python-version 3 --image-version composer-2.6.5-airflow-2.7.3^C student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --im age-version composer-2.6.5-airflow-2.7.3 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Configuring node location is not supported for Cloud Composer environments in versions 2.0.0 and newer. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --zone $COMPOSER_ZONE_ID --image-version composer-2.6.5-air flow-2.7.3 ERROR: (gcloud.composer.environments.create) Error parsing [environment]. The [environment] resource is not properly specified. Failed to find attribute [location]. The attribute can be set in the following ways: - provide the argument `environment` on the command line with a fully specified name - provide the argument `--location` on the command line - set the property `composer/location` student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --image-version composer-2.6.5-airflow-2.7.3 ERROR: (gcloud.composer.environments.create) FAILED_PRECONDITION: Composer API Service Agent service account (service-922910890009@cloudcomposer-accounts.iam.gserviceaccount.com) does not have required permissions set. Cloud Composer v2 API Service Agent Extension role might be missing. Please refer to https://cloud.google.com/composer/docs/composer-2/create-environments#grant-permissions and Composer Creation Troubleshooting pages to resolve this issue. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --image-version composer-2.6.5-airflow-2.7.3 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Configuring node location is not supported for Cloud Composer environments in versions 2.0.0 and newer. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID WARNING: Not defining --image-version resolves to Cloud Composer current default version, which is presently Composer 2 and is subject to further changes in the future. Consider using --image-version=composer-A-airflow-X[.Y[.Z]]. More info at https://cloud.google.com/composer/docs/concepts/versioning/composer-versioning-overview#version-aliases ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Configuring node location is not supported for Cloud Composer environments in versions 2.0.0 and newer. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$ gcloud composer environments create $COMPOSER_ENV_NAME --location $COMPOSER_REGION --zone $COMPOSER_ZONE_ID --image-version composer-2.6.5-airflow-2.7.3 ERROR: (gcloud.composer.environments.create) INVALID_ARGUMENT: Found 1 problem: 1) Configuring node location is not supported for Cloud Composer environments in versions 2.0.0 and newer. student_00_ea9e4e2b2fa3@cloudshell:~/ci-cd-for-data-processing-workflow/env-setup (qwiklabs-gcp-03-9b7a5801b2d0)$
Mark G. · Vor mehr als ein Jahr überprüft
Bryan G. · Vor mehr als ein Jahr überprüft
Wir können nicht garantieren, dass die veröffentlichten Rezensionen von Verbrauchern stammen, die die Produkte gekauft oder genutzt haben. Die Rezensionen werden von Google nicht überprüft.