Serverless Data Analysis with Dataflow: Side Inputs (Python) Reviews

Djamel Y. · Reviewed حوالي سنة ago

Takashi M. · Reviewed حوالي سنة ago

NICE

Chandrakanth Bhargav M. · Reviewed حوالي سنة ago

Manjusha n. · Reviewed حوالي سنة ago

Jesus L. · Reviewed حوالي سنة ago

Roop C. · Reviewed حوالي سنة ago

Freweyni T. · Reviewed حوالي سنة ago

the last command isn't running. tried multiple ways by replacing bucket, project and region.

Saumya K. · Reviewed حوالي سنة ago

Vahid P. · Reviewed حوالي سنة ago

Oliwier M. · Reviewed حوالي سنة ago

Jeffrey M. · Reviewed حوالي سنة ago

i had to install apache_beam to run the pipeline

HAMZA Z. · Reviewed حوالي سنة ago

Aishwarya P. · Reviewed حوالي سنة ago

Nitipon N. · Reviewed حوالي سنة ago

Jason C. · Reviewed حوالي سنة ago

Rocio M. · Reviewed حوالي سنة ago

Leelaram S. · Reviewed حوالي سنة ago

M.P G. · Reviewed حوالي سنة ago

Is returning this error and I can't finish the lab. The job is not created on dataflow student-00-5587f87edf3f@training-vm:~/training-data-analyst/courses/data_analysis/lab2/python$ python3 JavaProjectsThatNeedHelp.py --bucket $BUCKET --project $PROJECT --region $REGION --DataFlowRunner /home/student-00-5587f87edf3f/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py:166: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. bigqcollection = p | 'ReadFromBQ' >> beam.io.Read(beam.io.BigQuerySource(project=project,query=get_java_query)) /usr/local/lib/python3.9/dist-packages/apache_beam/io/gcp/bigquery.py:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( Traceback (most recent call last): File "/home/student-00-5587f87edf3f/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 190, in <module> run() File "/home/student-00-5587f87edf3f/training-data-analyst/courses/data_analysis/lab2/python/JavaProjectsThatNeedHelp.py", line 183, in run p.run() File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 550, in run return Pipeline.from_runner_api( File "/usr/local/lib/python3.9/dist-packages/apache_beam/pipeline.py", line 577, in run return self.runner.run_pipeline(self, self._options) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 542, in run_pipeline self.dataflow_client.create_job(self.job), self) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 777, in create_job return self.submit_job_description(job) File "/usr/local/lib/python3.9/dist-packages/apache_beam/utils/retry.py", line 275, in wrapper return fun(*args, **kwargs) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 877, in submit_job_description response = self._client.projects_locations_jobs.Create(request) File "/usr/local/lib/python3.9/dist-packages/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py", line 701, in Create return self._RunMethod( File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 731, in _RunMethod return self.ProcessHttpResponse(method_config, http_response, request) File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 737, in ProcessHttpResponse self.__ProcessHttpResponse(method_config, http_response, request)) File "/usr/local/lib/python3.9/dist-packages/apitools/base/py/base_api.py", line 603, in __ProcessHttpResponse raise exceptions.HttpError.FromResponse( apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/qwiklabs-gcp-00-ee0201defa3f/locations/us-west1/jobs?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Wed, 10 Jul 2024 08:43:07 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '137', '-content-encoding': 'gzip'}>, content <{ "error": { "code": 404, "message": "(83643e657e16f860): The workflow could not be created.", "status": "NOT_FOUND" } } >

Eduardo S. · Reviewed حوالي سنة ago

very satisfied

Vinod K. · Reviewed حوالي سنة ago

Thamizharasan R. · Reviewed حوالي سنة ago

Kriangkrai N. · Reviewed حوالي سنة ago

Sittigon W. · Reviewed حوالي سنة ago

JOSE . V. · Reviewed حوالي سنة ago

JOSE . V. · Reviewed حوالي سنة ago