Migrating Apache Spark Jobs to Dataproc [PWDW] Reviews

I think it is difficult

Andres P. · Reviewed 3 yıldan fazla ago

Louise S. · Reviewed 3 yıldan fazla ago

bigquery_analysis_cf7l8i596yq3kr Exception on /_ah/push-handlers/pubsub/projects/ebeaca11aa49fd913p-tp/topics/cloud-functions-l6j47da24h237nnerkoxebmdei [POST] Traceback (most recent call last): File "/layers/google.python.pip/pip/lib/python3.7/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 36, in <module> import db_dtypes # type: ignore ModuleNotFoundError: No module named 'db_dtypes' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/layers/google.python.pip/pip/lib/python3.7/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/layers/google.python.pip/pip/lib/python3.7/site-packages/flask/app.py", line 1518, in full_dispatch_request rv = self.handle_user_exception(e) File "/layers/google.python.pip/pip/lib/python3.7/site-packages/flask/app.py", line 1516, in full_dispatch_request rv = self.dispatch_request() File "/layers/google.python.pip/pip/lib/python3.7/site-packages/flask/app.py", line 1502, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) File "/layers/google.python.pip/pip/lib/python3.7/site-packages/functions_framework/__init__.py", line 171, in view_func function(data, context) File "/workspace/main.py", line 97, in bigquery_analysis_cf create_report(bucket, filename, tmpdir) File "/workspace/main.py", line 51, in create_report connections_by_protocol = client.query(sql).to_dataframe() File "/layers/google.python.pip/pip/lib/python3.7/site-packages/google/cloud/bigquery/job/query.py", line 1689, in to_dataframe geography_as_object=geography_as_object, File "/layers/google.python.pip/pip/lib/python3.7/site-packages/google/cloud/bigquery/table.py", line 1966, in to_dataframe _pandas_helpers.verify_pandas_imports() File "/layers/google.python.pip/pip/lib/python3.7/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 985, in verify_pandas_imports raise ValueError(_NO_DB_TYPES_ERROR) from db_dtypes_import_exception ValueError: Please install the 'db-dtypes' package to use this function.

Ganesh M. · Reviewed 3 yıldan fazla ago

no progress bar

Eric K. · Reviewed 3 yıldan fazla ago

Javier A. · Reviewed 3 yıldan fazla ago

Karsten S. · Reviewed 3 yıldan fazla ago

风振 曹. · Reviewed 3 yıldan fazla ago

Karthikeyan S. · Reviewed 3 yıldan fazla ago

Karthikeyan S. · Reviewed 3 yıldan fazla ago

Rakshita A. · Reviewed 3 yıldan fazla ago

Sushil K. · Reviewed 3 yıldan fazla ago

sachin s. · Reviewed 3 yıldan fazla ago

Pavan K. · Reviewed 3 yıldan fazla ago

Jun F. · Reviewed 3 yıldan fazla ago

Jun F. · Reviewed 3 yıldan fazla ago

Jun F. · Reviewed 3 yıldan fazla ago

some labels in the instructions do not match with the gcp console, especially in AI Platform

Boris K. · Reviewed 3 yıldan fazla ago

Miguel Ángel S. · Reviewed 3 yıldan fazla ago

Ramesh b. · Reviewed 3 yıldan fazla ago

Balaji E. · Reviewed 3 yıldan fazla ago

Victor G. · Reviewed 3 yıldan fazla ago

LORENA A. · Reviewed 3 yıldan fazla ago

Don S. · Reviewed 3 yıldan fazla ago

Prabha A. · Reviewed 3 yıldan fazla ago

Alexandre G. · Reviewed 3 yıldan fazla ago