Opiniones sobre Cómo ejecutar trabajos de Apache Spark en Cloud Dataproc

Received this recurring error despite following all the steps: Writing to qwiklabs-gcp-03-608e9beb365f Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 20/11/30 11:42:06 WARN org.apache.spark.util.Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041. 20/11/30 11:42:06 WARN org.apache.spark.util.Utils: Service 'SparkUI' could not bind on port 4041. Attempting port 4042. 20/11/30 11:42:07 WARN org.apache.spark.scheduler.FairSchedulableBuilder: Fair Scheduler configuration file not found so jobs will be scheduled in FIFO order. To use fair scheduling, configure pools in fairscheduler.xml or set spark.scheduler.allocation.file to a file that contains the configuration. [Stage 0:> (0 + 0) / 1]20/11/30 11:42:31 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:42:46 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:43:01 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:43:16 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources [Stage 0:> (0 + 0) / 1]20/11/30 11:43:31 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:43:46 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:44:01 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:44:16 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources [Stage 0:> (0 + 0) / 1]20/11/30 11:44:31 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:44:46 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:45:01 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:45:16 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources [Stage 0:> (0 + 0) / 1]20/11/30 11:45:31 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources 20/11/30 11:45:46 WARN org.apache.spark.scheduler.cluster.YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

Ahmad Fatih A. · Se revisó hace casi 6 años

Seiya S. · Se revisó hace casi 6 años

Subodh P. · Se revisó hace casi 6 años

Arup B. · Se revisó hace casi 6 años

Sajjad S. · Se revisó hace casi 6 años

Miguel F. · Se revisó hace casi 6 años

Tooba N. · Se revisó hace casi 6 años

Shreya P. · Se revisó hace casi 6 años

Hoin N. · Se revisó hace casi 6 años

Pawel K. · Se revisó hace casi 6 años

Monroe M. · Se revisó hace casi 6 años

good

boulealam c. · Se revisó hace casi 6 años

Anmol K. · Se revisó hace casi 6 años

good

Pratik M. · Se revisó hace casi 6 años

satisfied.

Navin S. · Se revisó hace casi 6 años

Zarot S. · Se revisó hace casi 6 años

very well structured

Murtaza M. · Se revisó hace casi 6 años

murugaboopathy s. · Se revisó hace casi 6 años

ALICIA T. · Se revisó hace casi 6 años

IVAN M. · Se revisó hace casi 6 años

Rafael V. · Se revisó hace casi 6 años

Leela M. · Se revisó hace casi 6 años

Joshua H. · Se revisó hace casi 6 años

Ranjan Kumar S. · Se revisó hace casi 6 años

Karthikeyan K. · Se revisó hace casi 6 años