Running Apache Spark jobs on Cloud Dataproc Reviews

Error in code Writing to qwiklabs-gcp-03-5fd0a6abd6c1 Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering MapOutputTracker 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMaster 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMasterHeartbeat 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering OutputCommitCoordinator Traceback (most recent call last): File "spark_analysis.py", line 14, in <module> ax[0].get_figure().savefig('report.png'); NameError: name 'ax' is not defined

Fadina A. · Reviewed около 4 лет ago

Oladimeji C. · Reviewed около 4 лет ago

Vipin U. · Reviewed около 4 лет ago

Ömer Ç. · Reviewed около 4 лет ago

Pradeep K. · Reviewed около 4 лет ago

Siwatchara S. · Reviewed около 4 лет ago

Mónica V. · Reviewed около 4 лет ago

Mike A. · Reviewed около 4 лет ago

Vipul D. · Reviewed около 4 лет ago

GLADSTONE B. · Reviewed около 4 лет ago

John G. · Reviewed около 4 лет ago

some steps are not correct. please check

Rajalukshmi R. · Reviewed около 4 лет ago

Abdulmajid B. · Reviewed около 4 лет ago

JORGE A. · Reviewed около 4 лет ago

some steps are unclear and not explained in simple terms though it could just be me unfamiliar of how things work using apache and how it translates to GCP.

DHAILE I. · Reviewed около 4 лет ago

Henry T. · Reviewed около 4 лет ago

Hoe Kit C. · Reviewed около 4 лет ago

sumabhavani k. · Reviewed около 4 лет ago

Kaveri K. · Reviewed около 4 лет ago

Lokeswar Reddy P. · Reviewed около 4 лет ago

yoganjaneya venkataBalasubrahmanyam p. · Reviewed около 4 лет ago

Mukul G. · Reviewed около 4 лет ago

The variable $PROJECT_ID didn't work in the gsutil URI. I had to manually substitute the project name into it. Running the pyspark script at the end generated an error and it wasn't clear how to find the logs to understand what had happened.

Stephen W. · Reviewed около 4 лет ago

Shashank K. · Reviewed около 4 лет ago

Mathankumar G. · Reviewed около 4 лет ago