An Introduction to Cloud Composer 2.5 Reviews

Bhavya Sai Sree K. · Reviewed 6 חודשים ago

Pravin D. · Reviewed 6 חודשים ago

Ashwini U. · Reviewed 6 חודשים ago

hadoop_tutorial.py doesn't work. I got an error: [2025-01-05, 04:55:35 UTC] {standard_task_runner.py:124} ERROR - Failed to execute job 6 for task create_dataproc_cluster (403 Failed to acquire credential for service robot for projectId 'qwiklabs-gcp-04-27a61aa003b9'; 5011)\nTraceback (most recent call last):\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/task/task_runner/standard_task_runner.py", line 117, in _start_by_fork\n ret = args.func(args, dag=self.dag)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/cli/cli_config.py", line 49, in command\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/utils/cli.py", line 115, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/cli/commands/task_command.py", line 489, in task_run\n task_return_code = _run_task_by_selected_method(args, _dag, ti)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/cli/commands/task_command.py", line 256, in _run_task_by_selected_method\n return _run_raw_task(args, ti)\n ^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/cli/commands/task_command.py", line 341, in _run_raw_task\n return ti._run_raw_task(\n ^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/utils/session.py", line 97, in wrapper\n return func(*args, session=session, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 3006, in _run_raw_task\n return _run_raw_task(\n ^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 273, in _run_raw_task\n TaskInstance._execute_task_with_callbacks(\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 3160, in _execute_task_with_callbacks\n result = self._execute_task(context, task_orig)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 3184, in _execute_task\n return _execute_task(self, context, task_orig)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 768, in _execute_task\n result = _execute_callable(context=context, **execute_callable_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 734, in _execute_callable\n return ExecutionCallableRunner(\n ^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/utils/operator_helpers.py", line 252, in run\n return self.func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 415, in wrapper\n return func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/providers/google/cloud/operators/dataproc.py", line 824, in execute\n operation = self._create_cluster(hook)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/providers/google/cloud/operators/dataproc.py", line 708, in _create_cluster\n return hook.create_cluster(\n ^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/providers/google/common/hooks/base_google.py", line 560, in inner_wrapper\n return func(self, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/airflow/providers/google/cloud/hooks/dataproc.py", line 349, in create_cluster\n result = client.create_cluster(\n ^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/google/cloud/dataproc_v1/services/cluster_controller/client.py", line 862, in create_cluster\n response = rpc(\n ^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/gapic_v1/method.py", line 131, in __call__\n return wrapped_func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/retry/retry_unary.py", line 293, in retry_wrapped_func\n return retry_target(\n ^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/retry/retry_unary.py", line 153, in retry_target\n _retry_error_helper(\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/retry/retry_base.py", line 212, in _retry_error_helper\n raise final_exc from source_exc\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/retry/retry_unary.py", line 144, in retry_target\n result = target()\n ^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/timeout.py", line 120, in func_with_timeout\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/opt/python3.11/lib/python3.11/site-packages/google/api_core/grpc_helpers.py", line 78, in error_remapped_callable\n raise exceptions.from_grpc_error(exc) from exc\ngoogle.api_core.exceptions.PermissionDenied: 403 Failed to acquire credential for service robot for projectId 'qwiklabs-gcp-04-27a61aa003b9' [2025-01-05, 04:55:35 UTC] {local_task_job_runner.py:266} INFO - Task exited with return code 1

Yunjung S. · Reviewed 6 חודשים ago

Aakash R. · Reviewed 6 חודשים ago

雅人 後. · Reviewed 6 חודשים ago

i'm stuck on first airflow task because of "up for retry" state

Maximiliano M. · Reviewed 6 חודשים ago

Asha K. · Reviewed 6 חודשים ago

Hector R. · Reviewed 6 חודשים ago

Eric O. · Reviewed 6 חודשים ago

Priya B. · Reviewed 6 חודשים ago

Sagar K. · Reviewed 6 חודשים ago

Vijaydeep K. · Reviewed 6 חודשים ago

Asha K. · Reviewed 6 חודשים ago

Kunal P. · Reviewed 6 חודשים ago

Tanya Z. · Reviewed 6 חודשים ago

Sean P. · Reviewed 6 חודשים ago

David Alberto F. · Reviewed 6 חודשים ago

David Alberto F. · Reviewed 6 חודשים ago

Kendal B. · Reviewed 6 חודשים ago

Mani S. · Reviewed 6 חודשים ago

Ankush S. · Reviewed 6 חודשים ago

Łukasz K. · Reviewed 6 חודשים ago

DIVYA S. · Reviewed 6 חודשים ago

Beami M. · Reviewed 6 חודשים ago