Use Serverless for Apache Spark to Load BigQuery Reviews

Anuj S. · Reviewed حوالي سنة ago

Anuj S. · Reviewed حوالي سنة ago

Sreenivasareddy B. · Reviewed حوالي سنة ago

I got this error when attempting the spark job, I tried to solve it but it was way over my knowledge level: Batch [2332b6b961d14bd399e0a93ccace27e9] submitted. ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Multiple Errors: - Failed to create batch autoscaling policy - Not authorized to requested resource. Running auto diagnostics on the batch. It may take few minutes before diagnostics output is available. Please check diagnostics output by running 'gcloud dataproc batches describe' command.

Rodrigo R. · Reviewed حوالي سنة ago

had quota issues, had to try a few times for the job to be submitted

Bharath K. · Reviewed حوالي سنة ago

Alankar G. · Reviewed حوالي سنة ago

Alexandre F. · Reviewed حوالي سنة ago

Sreenivasareddy B. · Reviewed حوالي سنة ago

Smitha R. · Reviewed حوالي سنة ago

Bauke d. · Reviewed حوالي سنة ago

Kunjal D. · Reviewed حوالي سنة ago

Yasha A. · Reviewed حوالي سنة ago

;)

Ricardo C. · Reviewed حوالي سنة ago

Paula A. · Reviewed حوالي سنة ago

Aïda S. · Reviewed حوالي سنة ago

Rutuja C. · Reviewed حوالي سنة ago

David W. · Reviewed حوالي سنة ago

Farook Hussain S. · Reviewed حوالي سنة ago

ERICO T. · Reviewed حوالي سنة ago

Sunitha A. · Reviewed حوالي سنة ago

Colin B. · Reviewed حوالي سنة ago

Sunitha A. · Reviewed حوالي سنة ago

Manasa P. · Reviewed حوالي سنة ago

The Spark code failed to run at first. I had to end the lab and start a new one, and my first attempt also failed with an error saying "Failed to create batch autoscaling policy" and "Not found: Gaia id not found for email service-165760230121@dataproc-accounts.iam.gserviceaccount.com"

Alexis L. · Reviewed حوالي سنة ago

Wayne S. · Reviewed حوالي سنة ago