Use Serverless for Apache Spark to Load BigQuery Reviews

Claudio Xavier d. · Reviewed over 1 year ago

Abhinav M. · Reviewed over 1 year ago

At task 3, I couldn't continue due to the following error when executing the spark code: ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Insufficient 'CPUS' quota. Requested 12.0, available 11.0. Your resource request exceeds your available quota. See https://cloud.google.com/compute/resource-usage. Use https://cloud.google.com/docs/quotas/view-manage#requesting_higher_quota to request additional quota. I have tried 24h later, got the same error but kept trying and it eventually went through. I guess you should update the warning message.

Beatriz J. · Reviewed over 1 year ago

Emmanuel S. · Reviewed over 1 year ago

Lina Marcela B. · Reviewed over 1 year ago

sintaxis error in task 3

Steven B. · Reviewed over 1 year ago

Mohamed B. · Reviewed over 1 year ago

Nicolas T. · Reviewed over 1 year ago

Task 3, step2 failed to run. ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Insufficient 'CPUS' quota. Requested 12.0, available 11.0.

Jennifer S. · Reviewed over 1 year ago

Jennifer S. · Reviewed over 1 year ago

thư t. · Reviewed over 1 year ago

I had to run the VM in the Cloud Shell. The Spark job took several runs to actually get enough resources provisioned to complete the batch properly. It took several checks to get the steps to "pass"/verify in the lab once it all successfully ran within the lab account.

Timothy W. · Reviewed over 1 year ago

Activity 3 had a quota issue. Had to run the code a couple times and just waited out to see it worked. Finally, ended up working after just waiting it out and checking the comments.

Moises A. · Reviewed over 1 year ago

Alexandru T. · Reviewed over 1 year ago

Jagadeesh H. · Reviewed over 1 year ago

Noor N. · Reviewed over 1 year ago

Girish M. · Reviewed over 1 year ago

siong n. · Reviewed over 1 year ago

Amit K. · Reviewed over 1 year ago

Wagner Omar A. · Reviewed over 1 year ago

Thanyalak L. · Reviewed over 1 year ago

CHENNA KESHAULU M. · Reviewed over 1 year ago

Nathan D. · Reviewed over 1 year ago

I had to go add perms to my IAM role to continue the Spark code execution. Once completed, Task 3 would not validate my progress. Task 4 validated OK.

Patrick S. · Reviewed over 1 year ago

Aline Evelyn d. · Reviewed over 1 year ago