Serverless Data Processing with Dataflow - Custom Dataflow Flex Templates (Java) Reviews

Finally completed on 4th try after Intermittent permission errors, most likely outta capacity? It doesn't seems to work without stagingLocation parameter. export PROJECT_ID=$(gcloud config get-value project) export REGION='us-central1' export JOB_NAME=mytemplate-$(date +%Y%m%H%M$S) export TEMPLATE_LOC=gs://${PROJECT_ID}/templates/mytemplate.json export INPUT_PATH=gs://${PROJECT_ID}/events.json export OUTPUT_PATH=gs://${PROJECT_ID}-coldline/ export BQ_TABLE=${PROJECT_ID}:logs.logs_filtered gcloud beta dataflow flex-template run ${JOB_NAME} \ --region=$REGION \ --template-file-gcs-location ${TEMPLATE_LOC} \ --parameters "inputPath=${INPUT_PATH},outputPath=${OUTPUT_PATH},tableName=${BQ_TABLE},stagingLocation=gs://${PROJECT_ID}/staging"

First name L. · Reviewed מעל 2 שנים ago

Could not get the template to work or launch, either give scope unauthorized or launcher HTTP 503

First name L. · Reviewed מעל 2 שנים ago

Sergio R. · Reviewed מעל 2 שנים ago

I had error during the lab, I can solve changing the region when lauching a job

Vitor O. · Reviewed מעל 2 שנים ago

FAISAL A. · Reviewed מעל 2 שנים ago

Last step did not work

Mario T. · Reviewed מעל 2 שנים ago

Nani D. · Reviewed מעל 2 שנים ago

Rakyan P. · Reviewed מעל 2 שנים ago

Jas S. · Reviewed מעל 2 שנים ago

Aditya R. · Reviewed מעל 2 שנים ago

Sergio R. · Reviewed מעל 2 שנים ago

Sergio R. · Reviewed מעל 2 שנים ago

done

PRAKASH KUMAR M. · Reviewed מעל 2 שנים ago

Impossible to do the lab due to IDE restricted by corporate politics

Juliette G. · Reviewed מעל 2 שנים ago

Kshitij T. · Reviewed מעל 2 שנים ago

Eugene K. · Reviewed מעל 2 שנים ago

María L. · Reviewed מעל 2 שנים ago

María L. · Reviewed מעל 2 שנים ago

PRADEEPKUMAR A. · Reviewed מעל 2 שנים ago

Justin U. · Reviewed מעל 2 שנים ago

Ivan J. · Reviewed מעל 2 שנים ago

Santosh T. · Reviewed מעל 2 שנים ago

Aman G. · Reviewed מעל 2 שנים ago

Aman G. · Reviewed כמעט 3 שנים ago

Sagar Kumar B. · Reviewed כמעט 3 שנים ago