Serverless Data Analysis with Dataflow: Side Inputs (Python) Reviews

Paul M. · Reviewed about 5 years ago

Viral U. · Reviewed about 5 years ago

Bardia M. · Reviewed about 5 years ago

Shekhar D. · Reviewed about 5 years ago

One problem, data flow jobs never starts on the first time.

MAITY S. · Reviewed about 5 years ago

Bardia M. · Reviewed about 5 years ago

Great Lab!!

Jose L. · Reviewed about 5 years ago

apache beam was deprecated and could run the python script

Samuel S. · Reviewed about 5 years ago

Zhiying J. · Reviewed about 5 years ago

Great Lab!

Jose L. · Reviewed about 5 years ago

Pranav V. · Reviewed about 5 years ago

William H. · Reviewed about 5 years ago

Chi K. · Reviewed about 5 years ago

Doug R. · Reviewed about 5 years ago

Harathi V. · Reviewed about 5 years ago

Gandluru, H. · Reviewed about 5 years ago

BALABHADRA H. · Reviewed about 5 years ago

Grzegorz S. · Reviewed about 5 years ago

Lokesh P. · Reviewed about 5 years ago

Andrés C. · Reviewed about 5 years ago

Marco A. · Reviewed about 5 years ago

JavaProjectsThatNeedHelp.py:163: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. bigqcollection = p | 'ReadFromBQ' >> beam.io.Read(beam.io.BigQuerySource(project=project,query=get_java_query)) /usr/local/lib/python3.7/dist-packages/apache_beam/io/gcp/bigquery.py:1881: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter.

Neearaj S. · Reviewed about 5 years ago

where are answer to these questions??: Looking at the class documentation at the very top, what is the purpose of this pipeline? Where does the content come from? What does the left side of the pipeline do? What does the right side of the pipeline do? What does ToLines do? (Hint: look at the content field of the BigQuery result) Why is the result of ReadFromBQ stored in a named PCollection instead of being directly passed to another step? What are the two actions carried out on the PCollection generated from ReadFromBQ? If a file has 3 FIXMEs and 2 TODOs in its content (on different lines), how many calls for help are associated with it? If a file is in the package com.google.devtools.build, what are the packages that it is associated with? popular_packages and help_packages are both named PCollections and both used in the Scores (side inputs) step of the pipeline. Which one is the main input and which is the side input? What is the method used in the Scores step? What Python data type is the side input converted into in the Scores step?

yogesh k. · Reviewed about 5 years ago

karthik p. · Reviewed about 5 years ago

Karan P. · Reviewed about 5 years ago