Running Jobs on Managed Apache Spark Reviews

Wei Hao L. · Reviewed over 6 years ago

You have to test the part of from pyspark.sql import SparkSession, SQLContext, Row gcs_bucket='[Your-Bucket-Name]' spark = SparkSession.builder.appName("kdd").getOrCreate() sc = spark.sparkContext data_file = "gs://"+gcs_bucket+"//kddcup.data_10_percent.gz" raw_rdd = sc.textFile(data_file).cache() raw_rdd.take(5) The bucket does not import the file with this instruction wget http://kdd.ics.uci.edu/databases/kddcup99/kddcup.data_10_percent.gz gsutil cp kddcup.data_10_percent.gz gs://$PROJECT_ID/

Adolfo C. · Reviewed over 6 years ago

jupyter notebook wouldn't load. couldn't even finish the lab.

Drew G. · Reviewed over 6 years ago

lu b. · Reviewed over 6 years ago

Andi Baso A. · Reviewed over 6 years ago

namsu H. · Reviewed over 6 years ago

I've got this error File "/tmp/6b2f23a3531f46359fa41c1ae8a561b6/spark_analysis.py", line 25, in <module> bucket.blob('sparktop/report.png').upload_from_filename('report.png') File "/opt/conda/default/lib/python3.6/site-packages/google/cloud/storage/blob.py", line 1388, in upload_from_filename with open(filename, "rb") as file_obj: FileNotFoundError: [Errno 2] No such file or directory: 'report.png'

Omar G. · Reviewed over 6 years ago

José C. · Reviewed over 6 years ago

Aaron D. · Reviewed over 6 years ago

nice

Eureka_T E. · Reviewed over 6 years ago

Phemelo S. · Reviewed over 6 years ago

Md Rashid R. · Reviewed over 6 years ago

suhail k. · Reviewed over 6 years ago

Error in matplotlib trying to save png file prevented last couple of steps.

Keith W. · Reviewed over 6 years ago

Jagadish Y. · Reviewed over 6 years ago

SHARON C. · Reviewed over 6 years ago

Jose Luis d. · Reviewed over 6 years ago

Enrico d. · Reviewed over 6 years ago

Kaloyan T. · Reviewed over 6 years ago

Need more time to understand better or to explore what's happening on the backend

deepa m. · Reviewed over 6 years ago

Aleksandar G. · Reviewed over 6 years ago

Moisés C. · Reviewed over 6 years ago

alex d. · Reviewed over 6 years ago

Julio M. · Reviewed over 6 years ago