Serverless Data Analysis with Dataflow: Side Inputs (Python) Reviews

Amber V. · Reviewed почти 5 лет ago

Marco B. · Reviewed почти 5 лет ago

Mounika M. · Reviewed почти 5 лет ago

Debjit D. · Reviewed почти 5 лет ago

Shuiyao H. · Reviewed почти 5 лет ago

Fabian R. · Reviewed почти 5 лет ago

nice

Fernando B. · Reviewed почти 5 лет ago

I ran the lab twice, all compute permissions, and the Dataflow developer permissions are set in IAM. Also, the dataflow api is enabled. Getting the following error: { "textPayload": "Workflow failed. Causes: There was a problem refreshing your credentials. Please check:\n1. Dataflow API is enabled for your project.\n2. Make sure both the Dataflow service account and the controller service account have sufficient permissions. If you are not specifying a controller service account, ensure the default Compute Engine service account [PROJECT_NUMBER]-compute@developer.gserviceaccount.com exists and has sufficient permissions. If you have deleted the default Compute Engine service account, you must specify a controller service account. For more information, see: https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#security_and_permissions_for_pipelines_on_google_cloud_platform. , There is no cloudservices robot account for your project. Please ensure that the Dataflow API is enabled for your project.", "insertId": "1caalucd1k89", "resource": { "type": "dataflow_step", "labels": { "job_id": "2021-05-22_14_32_31-18356347470885124198", "project_id": "253530009215", "step_id": "", "job_name": "javahelpjob", "region": "us-central1" } }, "timestamp": "2021-05-22T21:32:41.778758018Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/region": "us-central1", "dataflow.googleapis.com/job_id": "2021-05-22_14_32_31-18356347470885124198", "dataflow.googleapis.com/job_name": "javahelpjob" }, "logName": "projects/qwiklabs-gcp-03-643bb14836db/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2021-05-22T21:32:42.293763592Z" }

S O. · Reviewed почти 5 лет ago

S O. · Reviewed почти 5 лет ago

Saptarshi G. · Reviewed почти 5 лет ago

Felix T. · Reviewed почти 5 лет ago

Gauri J. · Reviewed почти 5 лет ago

Ashik R. · Reviewed почти 5 лет ago

Rajeev V. · Reviewed почти 5 лет ago

Vladimir P. · Reviewed почти 5 лет ago

Rochelle R. · Reviewed почти 5 лет ago

Rajeev V. · Reviewed почти 5 лет ago

Nguyễn N. · Reviewed почти 5 лет ago

Mark S. · Reviewed почти 5 лет ago

The lab cannot be completed by an error in dataflow javahelpjob

José F. · Reviewed почти 5 лет ago

Awseme

Sandip M. · Reviewed почти 5 лет ago

Diego T. · Reviewed почти 5 лет ago

python3 JavaProjectsThatNeedHelp.py --bucket $BUCKET --project $DEVSHELL_PROJECT_ID --DataFlowRunner JavaProjectsThatNeedHelp.py:163: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. bigqcollection = p | 'ReadFromBQ' >> beam.io.Read(beam.io.BigQuerySource(project=project,query=get_java_query)) /usr/local/lib/python3.7/dist-packages/apache_beam/io/gcp/bigquery.py:1881: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.

Diego T. · Reviewed почти 5 лет ago

Phung Minh H. · Reviewed почти 5 лет ago

Daniel W. · Reviewed почти 5 лет ago