Usar o Serverless para Apache Spark ao carregar o BigQuery avaliações

麗奈 谷. · Revisado há over 1 year

Thank you so much!

J JESUS G. · Revisado há over 1 year

Juan C. · Revisado há over 1 year

The below instruction could have been in little more detail. As I found dataproc identification tool not visible. Next, you're going to set a few environment variables into VM instance terminal and execute a Spark template to load data into BigQuery. Set the following environment variables for the Dataproc Serverless environment.

Sameer S. · Revisado há over 1 year

sandeep s. · Revisado há over 1 year

Jason M. · Revisado há over 1 year

error when submitting spark job ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Insufficient 'CPUS' quota. Requested 12.0, available 11.0. Your resource request exceeds your available quota. See https://cloud.google.com/compute/resource-usage. Use https://cloud.google.com/docs/quotas/view-manage#requesting_higher_quota to request additional quota. Running auto diagnostics on the batch. It may take few minutes before diagnostics output is available. Please check diagnostics output by running 'gcloud dataproc batches describe' command.

max s. · Revisado há over 1 year

trevor a. · Revisado há over 1 year

Murilo S. · Revisado há over 1 year

Sergiu D. · Revisado há over 1 year

Thanks Google

Wisdom K. · Revisado há over 1 year

Task 3.2 fails as the spark job needs additional IAM permissions to run the script. After adding the required permission the script passed without any issues. Lab needs to be updated with this additional step.

Vamshi K. · Revisado há over 1 year

Kirit C. · Revisado há over 1 year

there are some errors - just re-try after 2-3 mins

Tomasz M. · Revisado há over 1 year

Maitreyee R. · Revisado há over 1 year

Dawid G. · Revisado há over 1 year

Dmitry P. · Revisado há over 1 year

Task 3 check didn't work, but I was able to see the data in Task 4. Seems like something wrong with the check in Task 3.

Nick F. · Revisado há over 1 year

rida l. · Revisado há over 1 year

Priyambada S. · Revisado há over 1 year

Creative P. · Revisado há over 1 year

abdelhay h. · Revisado há over 1 year

Ujjal P. · Revisado há over 1 year

Raj V. · Revisado há over 1 year

Babita K. · Revisado há over 1 year