Use Serverless for Apache Spark to Load BigQuery Reviews

Anuj S. · Reviewed בערך שנה אחת ago

Anuj S. · Reviewed בערך שנה אחת ago

Sreenivasareddy B. · Reviewed בערך שנה אחת ago

I got this error when attempting the spark job, I tried to solve it but it was way over my knowledge level: Batch [2332b6b961d14bd399e0a93ccace27e9] submitted. ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Multiple Errors: - Failed to create batch autoscaling policy - Not authorized to requested resource. Running auto diagnostics on the batch. It may take few minutes before diagnostics output is available. Please check diagnostics output by running 'gcloud dataproc batches describe' command.

Rodrigo R. · Reviewed בערך שנה אחת ago

had quota issues, had to try a few times for the job to be submitted

Bharath K. · Reviewed בערך שנה אחת ago

Alankar G. · Reviewed בערך שנה אחת ago

Alexandre F. · Reviewed בערך שנה אחת ago

Sreenivasareddy B. · Reviewed בערך שנה אחת ago

Smitha R. · Reviewed בערך שנה אחת ago

Bauke d. · Reviewed בערך שנה אחת ago

Kunjal D. · Reviewed בערך שנה אחת ago

Yasha A. · Reviewed בערך שנה אחת ago

;)

Ricardo C. · Reviewed בערך שנה אחת ago

Paula A. · Reviewed בערך שנה אחת ago

Aïda S. · Reviewed בערך שנה אחת ago

Rutuja C. · Reviewed בערך שנה אחת ago

David W. · Reviewed בערך שנה אחת ago

Farook Hussain S. · Reviewed בערך שנה אחת ago

ERICO T. · Reviewed בערך שנה אחת ago

Sunitha A. · Reviewed בערך שנה אחת ago

Colin B. · Reviewed בערך שנה אחת ago

Sunitha A. · Reviewed בערך שנה אחת ago

Manasa P. · Reviewed בערך שנה אחת ago

The Spark code failed to run at first. I had to end the lab and start a new one, and my first attempt also failed with an error saying "Failed to create batch autoscaling policy" and "Not found: Gaia id not found for email service-165760230121@dataproc-accounts.iam.gserviceaccount.com"

Alexis L. · Reviewed בערך שנה אחת ago

Wayne S. · Reviewed בערך שנה אחת ago