Running Apache Spark jobs on Cloud Dataproc Reviews

Error in code Writing to qwiklabs-gcp-03-5fd0a6abd6c1 Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering MapOutputTracker 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMaster 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMasterHeartbeat 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering OutputCommitCoordinator Traceback (most recent call last): File "spark_analysis.py", line 14, in <module> ax[0].get_figure().savefig('report.png'); NameError: name 'ax' is not defined

Fadina A. · Reviewed about 4 years ago

Oladimeji C. · Reviewed about 4 years ago

Vipin U. · Reviewed about 4 years ago

Ömer Ç. · Reviewed about 4 years ago

Pradeep K. · Reviewed about 4 years ago

Siwatchara S. · Reviewed about 4 years ago

Mónica V. · Reviewed about 4 years ago

Mike A. · Reviewed about 4 years ago

Vipul D. · Reviewed about 4 years ago

GLADSTONE B. · Reviewed about 4 years ago

John G. · Reviewed about 4 years ago

some steps are not correct. please check

Rajalukshmi R. · Reviewed about 4 years ago

Abdulmajid B. · Reviewed about 4 years ago

JORGE A. · Reviewed about 4 years ago

some steps are unclear and not explained in simple terms though it could just be me unfamiliar of how things work using apache and how it translates to GCP.

DHAILE I. · Reviewed about 4 years ago

Henry T. · Reviewed about 4 years ago

Hoe Kit C. · Reviewed about 4 years ago

sumabhavani k. · Reviewed about 4 years ago

Kaveri K. · Reviewed about 4 years ago

Lokeswar Reddy P. · Reviewed about 4 years ago

yoganjaneya venkataBalasubrahmanyam p. · Reviewed about 4 years ago

Mukul G. · Reviewed about 4 years ago

The variable $PROJECT_ID didn't work in the gsutil URI. I had to manually substitute the project name into it. Running the pyspark script at the end generated an error and it wasn't clear how to find the logs to understand what had happened.

Stephen W. · Reviewed about 4 years ago

Shashank K. · Reviewed about 4 years ago

Mathankumar G. · Reviewed about 4 years ago