关于“使用 Dataflow 和 BigQuery (Python) 在 Google Cloud 上进行 ETL 处理”的评价

Chandan C. · 已于 over 2 years前审核

Roman M. · 已于 over 2 years前审核

Sayantan R. · 已于 over 2 years前审核

error on SDK deprecated aand error on python dataflow_python_examples/data_lake_to_mart.py \ --worker_disk_type="compute.googleapis.com/projects//zones//diskTypes/pd-ssd" \ --max_num_workers=4 \ --project=$PROJECT \ --runner=DataflowRunner \ --staging_location=gs://$PROJECT/test \ --temp_location gs://$PROJECT/test \ --save_main_session \ --region=us-central1 dataflow_python_examples/data_lake_to_mart.py:244: BeamDeprecationWarning: parse_table_schema_from_json is deprecated since 2.11.0. Use bigquery_tools.parse_table_schema_from_json instead. schema = parse_table_schema_from_json(data_lake_to_data_mart.schema_str) dataflow_python_examples/data_lake_to_mart.py:272: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. | 'Account Details' >> beam.Map( /usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/bigquery.py:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( dataflow_python_examples/data_lake_to_mart.py:300: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. write_disposition=beam.io.BigQueryDisposition.WRITE_TRUNCATE))) /usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/bigquery.py:1282: UserWarning: Native sinks no longer implemented; falling back to standard Beam sink. "Native sinks no longer implemented; " /usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/bigquery_file_loads.py:1166: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.project = self.project or p.options.view_as(GoogleCloudOptions).project Traceback (most recent call last): File "dataflow_python_examples/data_lake_to_mart.py", line 306, in <module> run() File "dataflow_python_examples/data_lake_to_mart.py", line 301, in run p.run().wait_until_finish() File "/usr/local/lib/python3.7/site-packages/apache_beam/pipeline.py", line 553, in run self._options).run(False) File "/usr/local/lib/python3.7/site-packages/apache_beam/pipeline.py", line 995, in from_runner_api raise ValueError('No producer for %s' % id) ValueError: No producer for ref_PCollection_PCollection_14

Agus S. · 已于 over 2 years前审核

Jens H. · 已于 over 2 years前审核

Mayank B. · 已于 over 2 years前审核

Jedidia T. · 已于 over 2 years前审核

Fonseca L. · 已于 over 2 years前审核

Phillip L. · 已于 over 2 years前审核

Dinup K. · 已于 over 2 years前审核

Dommy A. · 已于 over 2 years前审核

Sasmita N. · 已于 over 2 years前审核

Harshal G. · 已于 over 2 years前审核

Лёшка G. · 已于 over 2 years前审核

Oleksii T. · 已于 over 2 years前审核

Игорь К. · 已于 over 2 years前审核

Petri E. · 已于 over 2 years前审核

Adithya V. · 已于 over 2 years前审核

Shahrukkhan I. · 已于 over 2 years前审核

Sambhav D. · 已于 over 2 years前审核

Sergii S. · 已于 over 2 years前审核

Viktor M. · 已于 over 2 years前审核

Maksim M. · 已于 over 2 years前审核

Rosanne L. · 已于 over 2 years前审核

Olena G. · 已于 over 2 years前审核