Running Apache Spark jobs on Cloud Dataproc Reviews

Tommaso B. · Reviewed 7 ay ago

Uladzislau S. · Reviewed 7 ay ago

I get error, your code is wrong: student_03_cde3f97413f7@cloudshell:~ (qwiklabs-gcp-01-0ebbe203849c)$ ./submit_onejob.sh $PROJECT_ID Job [0da0657874f44983a6dc4f40cc23bf16] submitted. Waiting for job output... Traceback (most recent call last): File "/tmp/0da0657874f44983a6dc4f40cc23bf16/spark_analysis.py", line 12, in <module> ax[0].get_figure().savefig('report.png'); NameError: name 'ax' is not defined. Did you mean: 'max'? ERROR: (gcloud.dataproc.jobs.submit.pyspark) Job [0da0657874f44983a6dc4f40cc23bf16] failed with error: Job failed with message [NameError: name 'ax' is not defined. Did you mean: 'max'?]. Additional details can be found at: https://console.cloud.google.com/dataproc/jobs/0da0657874f44983a6dc4f40cc23bf16?project=qwiklabs-gcp-01-0ebbe203849c&region=us-east4 gcloud dataproc jobs wait '0da0657874f44983a6dc4f40cc23bf16' --region 'us-east4' --project 'qwiklabs-gcp-01-0ebbe203849c' https://console.cloud.google.com/storage/browser/dataproc-staging-us-east4-399443575506-1tded7sg/google-cloud-dataproc-metainfo/7387e0ab-fb80-457a-8559-fbf8ace41a21/jobs/0da0657874f44983a6dc4f40cc23bf16/ gs://dataproc-staging-us-east4-399443575506-1tded7sg/google-cloud-dataproc-metainfo/7387e0ab-fb80-457a-8559-fbf8ace41a21/jobs/0da0657874f44983a6dc4f40cc23bf16/driveroutput.*

Kaan E. · Reviewed 7 ay ago

RiteshKumar A. · Reviewed 7 ay ago

Ricardo C. · Reviewed 7 ay ago

Ismael F. · Reviewed 7 ay ago

Tushar C. · Reviewed 7 ay ago

Roderick S. · Reviewed 7 ay ago

Daniel C. · Reviewed 7 ay ago

Xiang T. · Reviewed 7 ay ago

Sharad P. · Reviewed 7 ay ago

Thiago M. · Reviewed 7 ay ago

Jupiter does not work - get 502 us-central1.dataproc.cloud.google.com

Marcin S. · Reviewed 7 ay ago

Bernardo A. · Reviewed 7 ay ago

aditya g. · Reviewed 7 ay ago

Vineet G. · Reviewed 7 ay ago

sonali s. · Reviewed 7 ay ago

Stefano P. · Reviewed 7 ay ago

Sathish M. · Reviewed 7 ay ago

Sabin S. · Reviewed 7 ay ago

Diwash U. · Reviewed 7 ay ago

Saifulloh achmad f. · Reviewed 7 ay ago

This lab was having lots of issues with version depreciation. I followed all the steps mentioned clearly but did not work. I tried to debug in the pyspark also did not work.

Diwash U. · Reviewed 7 ay ago

Valentyn S. · Reviewed 7 ay ago

Ha Thu N. · Reviewed 7 ay ago