리뷰 Dataflow와 BigQuery를 사용하여 Google Cloud에서 ETL 처리하기(Python)개

Favin F. · 거의 6년 전에 리뷰됨

HIROYUKI T. · 거의 6년 전에 리뷰됨

Keerthana B. · 거의 6년 전에 리뷰됨

K. R. · 거의 6년 전에 리뷰됨

Sameer Anand J. · 거의 6년 전에 리뷰됨

Did not work

Rishi A. · 거의 6년 전에 리뷰됨

Urja J. · 거의 6년 전에 리뷰됨

Hi team. The final task seems to require an older Beam SDK==2.23.0 to work. Error message using Beam==2.25.0: ValueError: Initializing SDFBoundedSourceRestrictionTracker requires a _SDFBoundedSourceRestriction [while running 'Read Account Details from BigQuery /ReadFromBigQuery/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)']

Bing Yuan L. · 거의 6년 전에 리뷰됨

The last one did not finish (tried a few times): INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-10-23_18_48_55-6903357488097196600 is in state JOB_STATE_FAILED Traceback (most recent call last): File "dataflow_python_examples/data_lake_to_mart.py", line 306, in <module> run() File "dataflow_python_examples/data_lake_to_mart.py", line 301, in run p.run().wait_until_finish() File "/home/student_02_aec7c56c687d/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 1650, in wait_until_finish self) apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Traceback (most recent call last): File "apache_beam/runners/common.py", line 1213, in apache_beam.runners.common.DoFnRunner.process File "apache_beam/runners/common.py", line 720, in apache_beam.runners.common.PerWindowInvoker.invoke_process File "apache_beam/runners/common.py", line 752, in apache_beam.runners.common.PerWindowInvoker._should_process_window_for_sdf File "apache_beam/runners/common.py", line 547, in apache_beam.runners.common.DoFnInvoker.invoke_create_tracker File "/usr/local/lib/python3.7/site-packages/apache_beam/io/iobase.py", line 1492, in create_tracker restriction) File "/usr/local/lib/python3.7/site-packages/apache_beam/io/iobase.py", line 1443, in __init__ 'Initializing SDFBoundedSourceRestrictionTracker' ValueError: Initializing SDFBoundedSourceRestrictionTracker requires a _SDFBoundedSourceRestriction During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 54, in dataflow_worker.native_operations.NativeReadOperation.start File "apache_beam/runners/worker/operations.py", line 356, in apache_beam.runners.worker.operations.Operation.output File "apache_beam/runners/worker/operations.py", line 218, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive File "apache_beam/runners/worker/operations.py", line 703, in apache_beam.runners.worker.operations.DoOperation.process File "apache_beam/runners/worker/operations.py", line 704, in apache_beam.runners.worker.operations.DoOperation.process File "apache_beam/runners/common.py", line 1215, in apache_beam.runners.common.DoFnRunner.process File "apache_beam/runners/common.py", line 1294, in apache_beam.runners.common.DoFnRunner._reraise_augmented

Lee Z. · 거의 6년 전에 리뷰됨

Haardik G. · 거의 6년 전에 리뷰됨

Shubham S. · 거의 6년 전에 리뷰됨

Kumar Adarsh P. · 거의 6년 전에 리뷰됨

Hernán M. · 거의 6년 전에 리뷰됨

Visvanathan A. · 거의 6년 전에 리뷰됨

saaya d. · 거의 6년 전에 리뷰됨

MOHIT KUMAR M. · 거의 6년 전에 리뷰됨

Mayank G. · 거의 6년 전에 리뷰됨

Tarunika R. · 거의 6년 전에 리뷰됨

Sumana B. · 거의 6년 전에 리뷰됨

Divya M. · 거의 6년 전에 리뷰됨

Diana E. · 거의 6년 전에 리뷰됨

Jainam S. · 거의 6년 전에 리뷰됨

very lengthy lab

Abhijeet p. · 거의 6년 전에 리뷰됨

Thavapalan A. · 거의 6년 전에 리뷰됨

nice.

jigar d. · 거의 6년 전에 리뷰됨