Como executar jobs do Apache Spark no Cloud Dataproc avaliações

Wei Hao L. · Revisado há over 6 years

You have to test the part of from pyspark.sql import SparkSession, SQLContext, Row gcs_bucket='[Your-Bucket-Name]' spark = SparkSession.builder.appName("kdd").getOrCreate() sc = spark.sparkContext data_file = "gs://"+gcs_bucket+"//kddcup.data_10_percent.gz" raw_rdd = sc.textFile(data_file).cache() raw_rdd.take(5) The bucket does not import the file with this instruction wget http://kdd.ics.uci.edu/databases/kddcup99/kddcup.data_10_percent.gz gsutil cp kddcup.data_10_percent.gz gs://$PROJECT_ID/

Adolfo C. · Revisado há over 6 years

jupyter notebook wouldn't load. couldn't even finish the lab.

Drew G. · Revisado há over 6 years

lu b. · Revisado há over 6 years

Andi Baso A. · Revisado há over 6 years

namsu H. · Revisado há over 6 years

I've got this error File "/tmp/6b2f23a3531f46359fa41c1ae8a561b6/spark_analysis.py", line 25, in <module> bucket.blob('sparktop/report.png').upload_from_filename('report.png') File "/opt/conda/default/lib/python3.6/site-packages/google/cloud/storage/blob.py", line 1388, in upload_from_filename with open(filename, "rb") as file_obj: FileNotFoundError: [Errno 2] No such file or directory: 'report.png'

Omar G. · Revisado há over 6 years

José C. · Revisado há over 6 years

Aaron D. · Revisado há over 6 years

nice

Eureka_T E. · Revisado há over 6 years

Phemelo S. · Revisado há over 6 years

Md Rashid R. · Revisado há over 6 years

suhail k. · Revisado há over 6 years

Error in matplotlib trying to save png file prevented last couple of steps.

Keith W. · Revisado há over 6 years

Jagadish Y. · Revisado há over 6 years

SHARON C. · Revisado há over 6 years

Jose Luis d. · Revisado há over 6 years

Enrico d. · Revisado há over 6 years

Kaloyan T. · Revisado há over 6 years

Need more time to understand better or to explore what's happening on the backend

deepa m. · Revisado há over 6 years

Aleksandar G. · Revisado há over 6 years

Moisés C. · Revisado há over 6 years

alex d. · Revisado há over 6 years

Julio M. · Revisado há over 6 years