Serverless Data Analysis with Dataflow: Side Inputs (Python) Ulasan

Djamel Y. · Diulas sekitar 1 tahun lalu

Takashi M. · Diulas sekitar 1 tahun lalu

NICE

Chandrakanth Bhargav M. · Diulas sekitar 1 tahun lalu

Manjusha n. · Diulas sekitar 1 tahun lalu

Jesus L. · Diulas sekitar 1 tahun lalu

Roop C. · Diulas sekitar 1 tahun lalu

Freweyni T. · Diulas sekitar 1 tahun lalu

the last command isn't running. tried multiple ways by replacing bucket, project and region.

Saumya K. · Diulas sekitar 1 tahun lalu

Vahid P. · Diulas sekitar 1 tahun lalu

Oliwier M. · Diulas sekitar 1 tahun lalu

Jeffrey M. · Diulas sekitar 1 tahun lalu

i had to install apache_beam to run the pipeline

HAMZA Z. · Diulas sekitar 1 tahun lalu

Aishwarya P. · Diulas sekitar 1 tahun lalu

Nitipon N. · Diulas sekitar 1 tahun lalu

Jason C. · Diulas sekitar 1 tahun lalu

Rocio M. · Diulas sekitar 1 tahun lalu

Leelaram S. · Diulas sekitar 1 tahun lalu

M.P G. · Diulas sekitar 1 tahun lalu

Is returning this error and I can't finish the lab. The job is not created on dataflow student-00-5587f87edf3f@training-vm:~/training-data-analyst/courses/data_analysis/lab2/python$ python3 JavaProjectsThatNeedHelp.py --bucket $BUCKET --project $PROJECT --region $REGION --DataFlowRunner /home/student-00-5587f87edf3f/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py:166: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. bigqcollection = p | 'ReadFromBQ' >> beam.io.Read(beam.io.BigQuerySource(project=project,query=get_java_query)) /usr/local/lib/python3.9/dist-packages/apache_beam/io/gcp/bigquery.py:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( Traceback (most recent call last): File "/home/student-00-5587f87edf3f/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 190, in <module> run() File "/home/student-00-5587f87edf3f/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 183, in run p.run() File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 550, in run return Pipeline.from_runner_api( File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 577, in run return self.runner.run_pipeline(self, self._options) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 542, in run_pipeline self.dataflow_client.create_job(self.job), self) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 777, in create_job return self.submit_job_description(job) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 877, in submit_job_description response = self._client.projects_locations_jobs.Create(request) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py", line 701, in Create return self._RunMethod( File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 731, in _RunMethod return self.ProcessHttpResponse(method_config, http_response, request) File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 737, in ProcessHttpResponse self.__ProcessHttpResponse(method_config, http_response, request)) File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 603, in __ProcessHttpResponse raise exceptions.HttpError.FromResponse( apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/qwiklabs-gcp-00-ee0201defa3f/locations/us-west1/jobs?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Wed, 10 Jul 2024 08:43:07 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '137', '-content-encoding': 'gzip'}>, content <{ "error": { "code": 404, "message": "(83643e657e16f860): The workflow could not be created.", "status": "NOT_FOUND" } } >

Eduardo S. · Diulas sekitar 1 tahun lalu

very satisfied

Vinod K. · Diulas sekitar 1 tahun lalu

Thamizharasan R. · Diulas sekitar 1 tahun lalu

Kriangkrai N. · Diulas sekitar 1 tahun lalu

Sittigon W. · Diulas sekitar 1 tahun lalu

JOSE . V. · Diulas sekitar 1 tahun lalu

JOSE . V. · Diulas sekitar 1 tahun lalu