ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

Satoru K. · Reviewed מעל 6 שנים ago

code snippet referred to in data_transformation.py - doesnt' seem to match that of what is in the git.

Hari S. · Reviewed מעל 6 שנים ago

Satoru K. · Reviewed מעל 6 שנים ago

1. Dataflow API's requires `--region` parameter, isn't part of command 2. Changes to `data_transformation.py` isn't required. 3. Worker quota issue while running `data_lake_to_mart.py`

santhosh k. · Reviewed מעל 6 שנים ago

Alamsyah A. · Reviewed מעל 6 שנים ago

最後の設問は面白かったですが、 dataflowの実行コマンドで、 --region=us-central1　がないとerrorが出ました。

Shinji S. · Reviewed מעל 6 שנים ago

gsutilでエラー発生、dataflow_python_examples/data_ingestion.pyを起動するコマンドが誤っている。また、コマンド実行する権限が無いとのメッセージが出るため、別途、サービスアカウントの作成が必要。などなど、問題が多すぎる。チャトで報告。3日後に再度確認したが直っていなかった。

Takayoshi I. · Reviewed מעל 6 שנים ago

copying files to bucket not working. reported to chat support

Glen S. · Reviewed מעל 6 שנים ago

bug with bucket access

Andrew L. · Reviewed מעל 6 שנים ago

the copy data files step for usa_names.csv and head_usa_names.csv is not working due to insufficient permission

Ilung P. · Reviewed מעל 6 שנים ago

error with copying files: gsutil cp gs://python-dataflow-example/data_files/head_usa_names.csv gs://$PROJECT/data_files/ AccessDeniedException: 403 There is an account problem for the requested project.

Tim R. · Reviewed מעל 6 שנים ago

gsutil cp gs://python-dataflow-example/data_files/usa_n ames.csv gs://$PROJECT/data_files/ AccessDeniedException: 403 There is an account problem for the requested project.

Toshiro M. · Reviewed מעל 6 שנים ago

There is an issue regarding access to the source buckets necessary for this lab that is currently being worked on. I will revisit this lab at a later time and provide an updated review then.

Alex T. · Reviewed מעל 6 שנים ago

Unable to copy the specified source CSV files. Error returned by gsutil is AccessDeniedException "There is an account problem for the requested project."

Alex T. · Reviewed מעל 6 שנים ago

Kept running into the following issue: (venv) student_01_02b8577558ee@cloudshell:~/professional-services/examples/dataflow-python-examples (qwiklabs-gcp-01-49d056156c90)$ gsutil cp gs://python-dataflow-example/data_files/usa_names.csv . AccessDeniedException: 403 There is an account problem for the requested project.

Yves C. · Reviewed מעל 6 שנים ago

Kenta N. · Reviewed מעל 6 שנים ago

Jayesh Vijay P. · Reviewed מעל 6 שנים ago

Ahmad Dzakwan A. · Reviewed מעל 6 שנים ago

Too many authentication-authorization errors and not enough time to correct them :(

Rolf S. · Reviewed מעל 6 שנים ago

Rolf S. · Reviewed מעל 6 שנים ago

wrong path gsutil cp gs://python-dataflow-example/data_files/usa_names.csv gs://$PROJECT/data_files/ gsutil cp gs://python-dataflow-example/data_files/head_usa_names.csv gs://$PROJECT/data_files/

Epam S. · Reviewed מעל 6 שנים ago

Mikkel Bloch L. · Reviewed מעל 6 שנים ago

Mikkel Bloch L. · Reviewed מעל 6 שנים ago

getting the following error while trying to access csv files: AccessDeniedException: 403 There is an account problem for the requested

Dheeraj A. · Reviewed מעל 6 שנים ago

Access problem to get .csv data??

Bill K. · Reviewed מעל 6 שנים ago