Running Apache Spark jobs on Cloud Dataproc Reviews

Error in code Writing to qwiklabs-gcp-03-5fd0a6abd6c1 Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering MapOutputTracker 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMaster 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering BlockManagerMasterHeartbeat 22/03/26 14:32:54 INFO org.apache.spark.SparkEnv: Registering OutputCommitCoordinator Traceback (most recent call last): File "spark_analysis.py", line 14, in <module> ax[0].get_figure().savefig('report.png'); NameError: name 'ax' is not defined

Fadina A. · Reviewed yaklaşık 4 yıl ago

Oladimeji C. · Reviewed yaklaşık 4 yıl ago

Vipin U. · Reviewed yaklaşık 4 yıl ago

Ömer Ç. · Reviewed yaklaşık 4 yıl ago

Pradeep K. · Reviewed yaklaşık 4 yıl ago

Siwatchara S. · Reviewed yaklaşık 4 yıl ago

Mónica V. · Reviewed yaklaşık 4 yıl ago

Mike A. · Reviewed yaklaşık 4 yıl ago

Vipul D. · Reviewed yaklaşık 4 yıl ago

GLADSTONE B. · Reviewed yaklaşık 4 yıl ago

John G. · Reviewed yaklaşık 4 yıl ago

some steps are not correct. please check

Rajalukshmi R. · Reviewed yaklaşık 4 yıl ago

Abdulmajid B. · Reviewed yaklaşık 4 yıl ago

JORGE A. · Reviewed yaklaşık 4 yıl ago

some steps are unclear and not explained in simple terms though it could just be me unfamiliar of how things work using apache and how it translates to GCP.

DHAILE I. · Reviewed yaklaşık 4 yıl ago

Henry T. · Reviewed yaklaşık 4 yıl ago

Hoe Kit C. · Reviewed yaklaşık 4 yıl ago

sumabhavani k. · Reviewed yaklaşık 4 yıl ago

Kaveri K. · Reviewed yaklaşık 4 yıl ago

Lokeswar Reddy P. · Reviewed yaklaşık 4 yıl ago

yoganjaneya venkataBalasubrahmanyam p. · Reviewed yaklaşık 4 yıl ago

Mukul G. · Reviewed yaklaşık 4 yıl ago

The variable $PROJECT_ID didn't work in the gsutil URI. I had to manually substitute the project name into it. Running the pyspark script at the end generated an error and it wasn't clear how to find the logs to understand what had happened.

Stephen W. · Reviewed yaklaşık 4 yıl ago

Shashank K. · Reviewed yaklaşık 4 yıl ago

Mathankumar G. · Reviewed yaklaşık 4 yıl ago