Dataflow と BigQuery を使用した Google Cloud での ETL 処理（Python） のレビュー

kumar Aditya · 5年以上前にレビュー済み

Xu Yue · 5年以上前にレビュー済み

Puliankeezhu Varghese Ebin · 5年以上前にレビュー済み

Lin Jacky · 5年以上前にレビュー済み

박찬영 Chanyoung Park · 5年以上前にレビュー済み

竹内 佳代子 · 5年以上前にレビュー済み

Panguluri Sri Harsha · 5年以上前にレビュー済み

Rahaman Muntakimur · 5年以上前にレビュー済み

Diaz Enriquez David Leonardo · 5年以上前にレビュー済み

Again ran this lab and follow all the instruction. Checked all the permissions are in place but still dataflow job failed with below error: Workflow failed. Causes: There was a problem refreshing your credentials. Please check: 1. Dataflow API is enabled for your project. 2. Make sure both the Dataflow service account and the controller service account have sufficient permissions. If you are not specifying a controller service account, ensure the default Compute Engine service account [PROJECT_NUMBER]-compute@developer.gserviceaccount.com exists and has sufficient permissions. If you have deleted the default Com pute Engine service account, you must specify a controller service account. For more information, see: https://cloud.google.com/dataflow/docs/concepts/security-and-permissio ns#security_and_permissions_for_pipelines_on_google_cloud_platform. , There is no cloudservices robot account for your project. Please ensure that the Dataflow API is enabl ed for your project.

Churiwala Rakesh · 5年以上前にレビュー済み

Ming Yi · 5年以上前にレビュー済み

Samal Chirag · 5年以上前にレビュー済み

Murugesan Krithika · 5年以上前にレビュー済み

Garello Miguel · 5年以上前にレビュー済み

Again ran this lab and follow all the instruction. Checked all the permissions are in place but still dataflow job failed with below error: Workflow failed. Causes: There was a problem refreshing your credentials. Please check: 1. Dataflow API is enabled for your project. 2. Make sure both the Dataflow service account and the controller service account have sufficient permissions. If you are not specifying a controller service account, ensure the default Compute Engine service account [PROJECT_NUMBER]-compute@developer.gserviceaccount.com exists and has sufficient permissions. If you have deleted the default Com pute Engine service account, you must specify a controller service account. For more information, see: https://cloud.google.com/dataflow/docs/concepts/security-and-permissio ns#security_and_permissions_for_pipelines_on_google_cloud_platform. , There is no cloudservices robot account for your project. Please ensure that the Dataflow API is enabl ed for your project.

Churiwala Rakesh · 5年以上前にレビュー済み

Follow lab steps but getting below error while running first dataflow job: python dataflow_python_examples/data_ingestion.py --project=$PROJECT --region=us-central1 --runner=DataflowRunner --staging_location=gs://$PROJECT/test --temp_location gs://$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Workflow failed. Causes: There was a problem refreshing your credentials. Please check: 1. Dataflow API is enabled for your project. 2. Make sure both the Dataflow service account and the controller service account have sufficient permissions. If you are not specifying a controller service account, ensure the default Compute Engine service account [PROJECT_NUMBER]-compute@developer.gserviceaccount.com exists and has sufficient permissions. If you have deleted the default Compute Engine service account, you must specify a controller service account. For more information, see: https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#security_and_permissions_for_pipelines_on_google_cloud_platform. , There is no cloudservices robot account for your project. Please ensure that the Dataflow API is enabled for your project.

Churiwala Rakesh · 5年以上前にレビュー済み

Quevedo Anita · 5年以上前にレビュー済み

Mitchell Steve · 5年以上前にレビュー済み

Very nicely setup lab.. Thank you

Singh Prakash · 5年以上前にレビュー済み

IWATA tomoomi · 5年以上前にレビュー済み

Jain Ruchir · 5年以上前にレビュー済み

sabeeha shaik · 5年以上前にレビュー済み

Martino Y · 5年以上前にレビュー済み

I had to add the following permissions on compute engine service account for this to work: Dataflow Admin Cloud Dataflow Service Agent Editor

Pasumarthi Sarma · 5年以上前にレビュー済み

T J · 5年以上前にレビュー済み