Running Apache Spark jobs on Cloud Dataproc Reviews

Error in code Writing to qwiklabs-gcp-03-5fd0a6abd6c1 Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering MapOutputTracker 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMaster 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMasterHeartbeat 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering OutputCommitCoordinator Traceback (most recent call last): File "spark_analysis.py", line 14, in <module> ax[0].get_figure().savefig('report.png'); NameError: name 'ax' is not defined

Fadina A. · Reviewed בערך 4 שנים ago

Oladimeji C. · Reviewed בערך 4 שנים ago

Vipin U. · Reviewed בערך 4 שנים ago

Ömer Ç. · Reviewed בערך 4 שנים ago

Pradeep K. · Reviewed בערך 4 שנים ago

Siwatchara S. · Reviewed בערך 4 שנים ago

Mónica V. · Reviewed בערך 4 שנים ago

Mike A. · Reviewed בערך 4 שנים ago

Vipul D. · Reviewed בערך 4 שנים ago

GLADSTONE B. · Reviewed בערך 4 שנים ago

John G. · Reviewed בערך 4 שנים ago

some steps are not correct. please check

Rajalukshmi R. · Reviewed בערך 4 שנים ago

Abdulmajid B. · Reviewed בערך 4 שנים ago

JORGE A. · Reviewed בערך 4 שנים ago

some steps are unclear and not explained in simple terms though it could just be me unfamiliar of how things work using apache and how it translates to GCP.

DHAILE I. · Reviewed בערך 4 שנים ago

Henry T. · Reviewed בערך 4 שנים ago

Hoe Kit C. · Reviewed בערך 4 שנים ago

sumabhavani k. · Reviewed בערך 4 שנים ago

Kaveri K. · Reviewed בערך 4 שנים ago

Lokeswar Reddy P. · Reviewed בערך 4 שנים ago

yoganjaneya venkataBalasubrahmanyam p. · Reviewed בערך 4 שנים ago

Mukul G. · Reviewed בערך 4 שנים ago

The variable $PROJECT_ID didn't work in the gsutil URI. I had to manually substitute the project name into it. Running the pyspark script at the end generated an error and it wasn't clear how to find the logs to understand what had happened.

Stephen W. · Reviewed בערך 4 שנים ago

Shashank K. · Reviewed בערך 4 שנים ago

Mathankumar G. · Reviewed בערך 4 שנים ago