Dataflow と BigQuery を使用した Google Cloud での ETL 処理（Python） のレビュー

Fernandes Favin · 6年弱前にレビュー済み

TSUCHIYA HIROYUKI · 6年弱前にレビュー済み

B Keerthana · 6年弱前にレビュー済み

Rushikesh Reddy K. · 6年弱前にレビュー済み

Jha Sameer Anand · 6年弱前にレビュー済み

Did not work

Agrawal Rishi · 6年弱前にレビュー済み

Jain Urja · 6年弱前にレビュー済み

Hi team. The final task seems to require an older Beam SDK==2.23.0 to work. Error message using Beam==2.25.0: ValueError: Initializing SDFBoundedSourceRestrictionTracker requires a _SDFBoundedSourceRestriction [while running 'Read Account Details from BigQuery /ReadFromBigQuery/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)']

Lee Bing Yuan · 6年弱前にレビュー済み

The last one did not finish (tried a few times): INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-10-23_18_48_55-6903357488097196600 is in state JOB_STATE_FAILED Traceback (most recent call last): File "dataflow_python_examples/data_lake_to_mart.py", line 306, in <module> run() File "dataflow_python_examples/data_lake_to_mart.py", line 301, in run p.run().wait_until_finish() File "/home/student_02_aec7c56c687d/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 1650, in wait_until_finish self) apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Traceback (most recent call last): File "apache_beam/runners/common.py", line 1213, in apache_beam.runners.common.DoFnRunner.process File "apache_beam/runners/common.py", line 720, in apache_beam.runners.common.PerWindowInvoker.invoke_process File "apache_beam/runners/common.py", line 752, in apache_beam.runners.common.PerWindowInvoker._should_process_window_for_sdf File "apache_beam/runners/common.py", line 547, in apache_beam.runners.common.DoFnInvoker.invoke_create_tracker File "/usr/local/lib/python3.7/site-packages/apache_beam/io/iobase.py", line 1492, in create_tracker restriction) File "/usr/local/lib/python3.7/site-packages/apache_beam/io/iobase.py", line 1443, in __init__ 'Initializing SDFBoundedSourceRestrictionTracker' ValueError: Initializing SDFBoundedSourceRestrictionTracker requires a _SDFBoundedSourceRestriction During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 54, in dataflow_worker.native_operations.NativeReadOperation.start File "apache_beam/runners/worker/operations.py", line 356, in apache_beam.runners.worker.operations.Operation.output File "apache_beam/runners/worker/operations.py", line 218, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive File "apache_beam/runners/worker/operations.py", line 703, in apache_beam.runners.worker.operations.DoOperation.process File "apache_beam/runners/worker/operations.py", line 704, in apache_beam.runners.worker.operations.DoOperation.process File "apache_beam/runners/common.py", line 1215, in apache_beam.runners.common.DoFnRunner.process File "apache_beam/runners/common.py", line 1294, in apache_beam.runners.common.DoFnRunner._reraise_augmented

Zhao Lee · 6年弱前にレビュー済み

Gilhotra Haardik · 6年弱前にレビュー済み

Sarthak Gupta Shubham · 6年弱前にレビュー済み

Pandita Kumar Adarsh · 6年弱前にレビュー済み

Marcelo Peralta Vela Hernán · 6年弱前にレビュー済み

Ananthan Visvanathan · 6年弱前にレビュー済み

dua saaya · 6年弱前にレビュー済み

MITTAL MOHIT KUMAR · 6年弱前にレビュー済み

Garg Mayank · 6年弱前にレビュー済み

RS Tarunika · 6年弱前にレビュー済み

Basu Sumana · 6年弱前にレビュー済み

Maunikhiya Divya · 6年弱前にレビュー済み

Ekka Diana · 6年弱前にレビュー済み

Shah Jainam · 6年弱前にレビュー済み

very lengthy lab

prashar Abhijeet · 6年弱前にレビュー済み

Arivan Thavapalan · 6年弱前にレビュー済み

nice.

donga jigar · 6年弱前にレビュー済み