Use Serverless for Apache Spark to Load BigQuery Reviews

Juan C. · Reviewed 1 yıldan fazla ago

The below instruction could have been in little more detail. As I found dataproc identification tool not visible. Next, you're going to set a few environment variables into VM instance terminal and execute a Spark template to load data into BigQuery. Set the following environment variables for the Dataproc Serverless environment.

Sameer S. · Reviewed 1 yıldan fazla ago

sandeep s. · Reviewed 1 yıldan fazla ago

Jason M. · Reviewed 1 yıldan fazla ago

error when submitting spark job ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Insufficient 'CPUS' quota. Requested 12.0, available 11.0. Your resource request exceeds your available quota. See https://cloud.google.com/compute/resource-usage. Use https://cloud.google.com/docs/quotas/view-manage#requesting_higher_quota to request additional quota. Running auto diagnostics on the batch. It may take few minutes before diagnostics output is available. Please check diagnostics output by running 'gcloud dataproc batches describe' command.

max s. · Reviewed 1 yıldan fazla ago

trevor a. · Reviewed 1 yıldan fazla ago

Murilo S. · Reviewed 1 yıldan fazla ago

Sergiu D. · Reviewed 1 yıldan fazla ago

Thanks Google

Wisdom K. · Reviewed 1 yıldan fazla ago

Task 3.2 fails as the spark job needs additional IAM permissions to run the script. After adding the required permission the script passed without any issues. Lab needs to be updated with this additional step.

Vamshi K. · Reviewed 1 yıldan fazla ago

Kirit C. · Reviewed 1 yıldan fazla ago

there are some errors - just re-try after 2-3 mins

Tomasz M. · Reviewed 1 yıldan fazla ago

Maitreyee R. · Reviewed 1 yıldan fazla ago

Dawid G. · Reviewed 1 yıldan fazla ago

Dmitry P. · Reviewed 1 yıldan fazla ago

Task 3 check didn't work, but I was able to see the data in Task 4. Seems like something wrong with the check in Task 3.

Nick F. · Reviewed 1 yıldan fazla ago

rida l. · Reviewed 1 yıldan fazla ago

Priyambada S. · Reviewed 1 yıldan fazla ago

Creative P. · Reviewed 1 yıldan fazla ago

abdelhay h. · Reviewed 1 yıldan fazla ago

Ujjal P. · Reviewed 1 yıldan fazla ago

Raj V. · Reviewed 1 yıldan fazla ago

Babita K. · Reviewed 1 yıldan fazla ago

MUY LENTO EL PASO DE SPARK

FABRICIO JOCABED V. · Reviewed 1 yıldan fazla ago

Hayato S. · Reviewed 1 yıldan fazla ago