Serverless Data Analysis with Dataflow: Side Inputs (Python) Reviews

Philippe P. · Reviewed מעל שנה אחת ago

Excellent

NNOGGE L. · Reviewed מעל שנה אחת ago

Soubhik M. · Reviewed מעל שנה אחת ago

Jeevan C. · Reviewed מעל שנה אחת ago

Shourya S. · Reviewed מעל שנה אחת ago

Pranab K. · Reviewed מעל שנה אחת ago

Vikrant B. · Reviewed מעל שנה אחת ago

Pratim G. · Reviewed מעל שנה אחת ago

Cool Beam application, I didn't understand the math.log tournament effect though

Alex H. · Reviewed מעל שנה אחת ago

David F. · Reviewed מעל שנה אחת ago

Valentino Mariano S. · Reviewed מעל שנה אחת ago

Amadeu C. · Reviewed מעל שנה אחת ago

python script has many errors Traceback (most recent call last): File "/home/student-02-c89edf359b6a/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 190, in <module> run() File "/home/student-02-c89edf359b6a/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 183, in run p.run() File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 550, in run return Pipeline.from_runner_api( File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 577, in run return self.runner.run_pipeline(self, self._options) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 542, in run_pipeline self.dataflow_client.create_job(self.job), self) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 777, in create_job return self.submit_job_description(job) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 877, in submit_job_description response = self._client.projects_locations_jobs.Create(request) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py", line 701, in Create return self._RunMethod( File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 731, in _RunMethod return self.ProcessHttpResponse(method_config, http_response, request) File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 737, in ProcessHttpResponse self.__ProcessHttpResponse(method_config, http_response, request)) File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 603, in __ProcessHttpResponse raise exceptions.HttpError.FromResponse( apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/qwiklabs-gcp-03-b64db1f85b87/locations/us-east1/jobs?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Wed, 01 May 2024 19:54:00 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '137', '-content-encoding': 'gzip'}>, content <{ "error": { "code": 404, "message": "(1c5508070688095d): The workflow could not be created.", "status": "NOT_FOUND" } }

Sergio David Q. · Reviewed מעל שנה אחת ago

python script has many errors Traceback (most recent call last): File "/home/student-03-97495b994738/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 190, in <module> run() File "/home/student-03-97495b994738/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 183, in run p.run() File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 550, in run return Pipeline.from_runner_api( File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 577, in run return self.runner.run_pipeline(self, self._options) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 542, in run_pipeline self.dataflow_client.create_job(self.job), self) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 750, in create_job self.create_job_description(job) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 836, in create_job_description resources = self._stage_resources(job.proto_pipeline, job.options) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 702, in _stage_resources staged_resources = resource_stager.stage_job_resources( File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/portability/stager.py", line 406, in stage_job_resources self.stage_artifact( File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 1119, in stage_artifact self._dataflow_application_client._gcs_file_copy( File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 602, in _gcs_file_copy self._uncached_gcs_file_copy(from_path, to_path) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 288, in wrapper raise exn.with_traceback(exn_traceback) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 624, in _uncached_gcs_file_copy self.stage_file(to_folder, to_name, f, total_size=total_size) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 735, in stage_file raise IOError(( OSError: Could not upload to GCS path gs://qwiklabs-gcp-04-0852f66a9ac3/staging/javahelpjob.1714591753.390637: bucket not found. Please verify that credentials are valid and that you have write access to the specified path.

Sergio David Q. · Reviewed מעל שנה אחת ago

Ratika M. · Reviewed מעל שנה אחת ago

Mehdi K. · Reviewed מעל שנה אחת ago

venkateswarlu p. · Reviewed מעל שנה אחת ago

Jean T. · Reviewed מעל שנה אחת ago

Mahdy M. · Reviewed מעל שנה אחת ago

Allen Z. · Reviewed מעל שנה אחת ago

Kiran K. · Reviewed מעל שנה אחת ago

翔 服. · Reviewed מעל שנה אחת ago

翔 服. · Reviewed מעל שנה אחת ago

Medhat E. · Reviewed מעל שנה אחת ago

Cristhyan E. · Reviewed מעל שנה אחת ago