Use Serverless for Apache Spark to Load BigQuery Reviews

I got this error when attempting the spark job, I tried to solve it but it was way over my knowledge level: Batch [2332b6b961d14bd399e0a93ccace27e9] submitted. ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Multiple Errors: - Failed to create batch autoscaling policy - Not authorized to requested resource. Running auto diagnostics on the batch. It may take few minutes before diagnostics output is available. Please check diagnostics output by running 'gcloud dataproc batches describe' command.

Rodrigo R. · Reviewed yaklaşık 1 yıl ago

had quota issues, had to try a few times for the job to be submitted

Bharath K. · Reviewed yaklaşık 1 yıl ago

Alankar G. · Reviewed yaklaşık 1 yıl ago

Alexandre F. · Reviewed yaklaşık 1 yıl ago

Sreenivasareddy B. · Reviewed yaklaşık 1 yıl ago

Smitha R. · Reviewed yaklaşık 1 yıl ago

Bauke d. · Reviewed yaklaşık 1 yıl ago

Kunjal D. · Reviewed yaklaşık 1 yıl ago

Yasha A. · Reviewed yaklaşık 1 yıl ago

;)

Ricardo C. · Reviewed yaklaşık 1 yıl ago

Paula A. · Reviewed yaklaşık 1 yıl ago

Aïda S. · Reviewed yaklaşık 1 yıl ago

Rutuja C. · Reviewed yaklaşık 1 yıl ago

David W. · Reviewed yaklaşık 1 yıl ago

Farook Hussain S. · Reviewed yaklaşık 1 yıl ago

ERICO T. · Reviewed yaklaşık 1 yıl ago

Sunitha A. · Reviewed yaklaşık 1 yıl ago

Colin B. · Reviewed yaklaşık 1 yıl ago

Sunitha A. · Reviewed yaklaşık 1 yıl ago

Manasa P. · Reviewed yaklaşık 1 yıl ago

The Spark code failed to run at first. I had to end the lab and start a new one, and my first attempt also failed with an error saying "Failed to create batch autoscaling policy" and "Not found: Gaia id not found for email service-165760230121@dataproc-accounts.iam.gserviceaccount.com"

Alexis L. · Reviewed yaklaşık 1 yıl ago

Wayne S. · Reviewed yaklaşık 1 yıl ago

Adrian T. · Reviewed yaklaşık 1 yıl ago

ana r. · Reviewed yaklaşık 1 yıl ago

Ravi TEJA B. · Reviewed yaklaşık 1 yıl ago