Running Apache Spark jobs on Cloud Dataproc Reviews

Error in code Writing to qwiklabs-gcp-03-5fd0a6abd6c1 Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering MapOutputTracker 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMaster 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMasterHeartbeat 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering OutputCommitCoordinator Traceback (most recent call last): File "spark_analysis.py", line 14, in <module> ax[0].get_figure().savefig('report.png'); NameError: name 'ax' is not defined

Fadina A. · Reviewed حوالي 4 سنوات ago

Oladimeji C. · Reviewed حوالي 4 سنوات ago

Vipin U. · Reviewed حوالي 4 سنوات ago

Ömer Ç. · Reviewed حوالي 4 سنوات ago

Pradeep K. · Reviewed حوالي 4 سنوات ago

Siwatchara S. · Reviewed حوالي 4 سنوات ago

Mónica V. · Reviewed حوالي 4 سنوات ago

Mike A. · Reviewed حوالي 4 سنوات ago

Vipul D. · Reviewed حوالي 4 سنوات ago

GLADSTONE B. · Reviewed حوالي 4 سنوات ago

John G. · Reviewed حوالي 4 سنوات ago

some steps are not correct. please check

Rajalukshmi R. · Reviewed حوالي 4 سنوات ago

Abdulmajid B. · Reviewed حوالي 4 سنوات ago

JORGE A. · Reviewed حوالي 4 سنوات ago

some steps are unclear and not explained in simple terms though it could just be me unfamiliar of how things work using apache and how it translates to GCP.

DHAILE I. · Reviewed حوالي 4 سنوات ago

Henry T. · Reviewed حوالي 4 سنوات ago

Hoe Kit C. · Reviewed حوالي 4 سنوات ago

sumabhavani k. · Reviewed حوالي 4 سنوات ago

Kaveri K. · Reviewed حوالي 4 سنوات ago

Lokeswar Reddy P. · Reviewed حوالي 4 سنوات ago

yoganjaneya venkataBalasubrahmanyam p. · Reviewed حوالي 4 سنوات ago

Mukul G. · Reviewed حوالي 4 سنوات ago

The variable $PROJECT_ID didn't work in the gsutil URI. I had to manually substitute the project name into it. Running the pyspark script at the end generated an error and it wasn't clear how to find the logs to understand what had happened.

Stephen W. · Reviewed حوالي 4 سنوات ago

Shashank K. · Reviewed حوالي 4 سنوات ago

Mathankumar G. · Reviewed حوالي 4 سنوات ago