Processamento de dados sem servidor com o Dataflow: como usar o Dataflow para análise de streaming (Python) avaliações

Kranthi Kumar B. · Revisado há 10 months

GOURAV J. · Revisado há 10 months

Diego M. · Revisado há 10 months

Thales R. · Revisado há 10 months

Beach C. · Revisado há 10 months

Ardra R. · Revisado há 10 months

Ahmed H. · Revisado há 10 months

Abhendra S. · Revisado há 10 months

Alexandre Bonfim M. · Revisado há 10 months

Imran S. · Revisado há 10 months

João Paulo A. · Revisado há 10 months

Jose A. · Revisado há 10 months

Peter Sahayaraj M. · Revisado há 10 months

Yevhenii Z. · Revisado há 10 months

Raffaele T. · Revisado há 10 months

Alejandro A. · Revisado há 10 months

Iulia V. · Revisado há 10 months

Anžela M. · Revisado há 10 months

error and I dont know why WARNING:apache_beam.runners.dataflow.dataflow_runner:2024-08-13T10:47:22.488Z: JOB_MESSAGE_WARNING: Autoscaling is enabled for Dataflow Streaming Engine. Workers will scale between 1 and 100 unless maxNumWorkers is specified. ERROR:apache_beam.runners.dataflow.dataflow_runner:2024-08-13T10:47:25.709Z: JOB_MESSAGE_ERROR: [The preflight pipeline validation failed for job 2024-08-13_03_47_20-6672254742816284992. To bypass the validation, use the Dataflow service option with the value enable_preflight_validation=false. Learn more at https://cloud.google.com/dataflow/docs/guides/deploying-a-pipeline#validation] Missing permissions pubsub.topics.get, pubsub.topics.attachSubscription when accessing projects/qwiklabs-gcp-01-f08f0be84928/topics/my_topic as Dataflow worker service account 1068741177169-compute@developer.gserviceaccount.com. Learn more at https://cloud.google.com/dataflow/docs/guides/troubleshoot-permissions#validation-failed. ERROR:apache_beam.runners.dataflow.dataflow_runner:2024-08-13T10:47:25.741Z: JOB_MESSAGE_ERROR: Error processing pipeline. INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2024-08-13_03_47_20-6672254742816284992 is in state JOB_STATE_FAILED ERROR:apache_beam.runners.dataflow.dataflow_runner:Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2024-08-13_03_47_20-6672254742816284992?project=<ProjectId> Traceback (most recent call last): File "/home/jupyter/training-data-analyst/quests/dataflow_python/5_Streaming_Analytics/lab/streaming_minute_traffic_pipeline.py", line 174, in <module> run() File "/home/jupyter/training-data-analyst/quests/dataflow_python/5_Streaming_Analytics/lab/streaming_minute_traffic_pipeline.py", line 171, in run p.run().wait_until_finish() File "/opt/conda/lib/python3.10/site-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 807, in wait_until_finish raise DataflowRuntimeException( apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Error processing pipeline. (base) root@1a734f51663d:/home/jupyter/training-data-analyst/quests/dataflow_python/5_Streaming_Analytics/lab#

Philip T. · Revisado há 10 months

Sergio V. · Revisado há 10 months

Joaquin S. · Revisado há 10 months

I do what's needed with zero errors, but when I check my progress, it's always marked as incomplete! Please fix your labs!

Khalid O. · Revisado há 10 months

Abdesselem R. · Revisado há 10 months

Juan Esteban D. · Revisado há 10 months

Ezequiel F. · Revisado há 10 months