Opinie (ETL Processing on Google Cloud Using Dataflow and BigQuery (Python))

Favin F. · Sprawdzono prawie 6 lat temu

HIROYUKI T. · Sprawdzono prawie 6 lat temu

Keerthana B. · Sprawdzono prawie 6 lat temu

K. R. · Sprawdzono prawie 6 lat temu

Sameer Anand J. · Sprawdzono prawie 6 lat temu

Did not work

Rishi A. · Sprawdzono prawie 6 lat temu

Urja J. · Sprawdzono prawie 6 lat temu

Hi team. The final task seems to require an older Beam SDK==2.23.0 to work. Error message using Beam==2.25.0: ValueError: Initializing SDFBoundedSourceRestrictionTracker requires a _SDFBoundedSourceRestriction [while running 'Read Account Details from BigQuery /ReadFromBigQuery/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)']

Bing Yuan L. · Sprawdzono prawie 6 lat temu

The last one did not finish (tried a few times): INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-10-23_18_48_55-6903357488097196600 is in state JOB_STATE_FAILED Traceback (most recent call last): File "dataflow_python_examples/data_lake_to_mart.py", line 306, in <module> run() File "dataflow_python_examples/data_lake_to_mart.py", line 301, in run p.run().wait_until_finish() File "/home/student_02_aec7c56c687d/dataflow-python-examples/venv/lib/python3.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 1650, in wait_until_finish self) apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Traceback (most recent call last): File "apache_beam/runners/common.py", line 1213, in apache_beam.runners.common.DoFnRunner.process File "apache_beam/runners/common.py", line 720, in apache_beam.runners.common.PerWindowInvoker.invoke_process File "apache_beam/runners/common.py", line 752, in apache_beam.runners.common.PerWindowInvoker._should_process_window_for_sdf File "apache_beam/runners/common.py", line 547, in apache_beam.runners.common.DoFnInvoker.invoke_create_tracker File "/usr/local/lib/python3.7/site-packages/apache_beam/io/iobase.py", line 1492, in create_tracker restriction) File "/usr/local/lib/python3.7/site-packages/apache_beam/io/iobase.py", line 1443, in __init__ 'Initializing SDFBoundedSourceRestrictionTracker' ValueError: Initializing SDFBoundedSourceRestrictionTracker requires a _SDFBoundedSourceRestriction During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 54, in dataflow_worker.native_operations.NativeReadOperation.start File "apache_beam/runners/worker/operations.py", line 356, in apache_beam.runners.worker.operations.Operation.output File "apache_beam/runners/worker/operations.py", line 218, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive File "apache_beam/runners/worker/operations.py", line 703, in apache_beam.runners.worker.operations.DoOperation.process File "apache_beam/runners/worker/operations.py", line 704, in apache_beam.runners.worker.operations.DoOperation.process File "apache_beam/runners/common.py", line 1215, in apache_beam.runners.common.DoFnRunner.process File "apache_beam/runners/common.py", line 1294, in apache_beam.runners.common.DoFnRunner._reraise_augmented

Lee Z. · Sprawdzono prawie 6 lat temu

Haardik G. · Sprawdzono prawie 6 lat temu

Shubham S. · Sprawdzono prawie 6 lat temu

Kumar Adarsh P. · Sprawdzono prawie 6 lat temu

Hernán M. · Sprawdzono prawie 6 lat temu

Visvanathan A. · Sprawdzono prawie 6 lat temu

saaya d. · Sprawdzono prawie 6 lat temu

MOHIT KUMAR M. · Sprawdzono prawie 6 lat temu

Mayank G. · Sprawdzono prawie 6 lat temu

Tarunika R. · Sprawdzono prawie 6 lat temu

Sumana B. · Sprawdzono prawie 6 lat temu

Divya M. · Sprawdzono prawie 6 lat temu

Diana E. · Sprawdzono prawie 6 lat temu

Jainam S. · Sprawdzono prawie 6 lat temu

very lengthy lab

Abhijeet p. · Sprawdzono prawie 6 lat temu

Thavapalan A. · Sprawdzono prawie 6 lat temu

nice.

jigar d. · Sprawdzono prawie 6 lat temu