Opiniones sobre Procesamiento de datos sin servidores con Dataflow: Cómo escribir una canalización de ETL con Apache Beam y Dataflow (Java)

Maryna B. · Se revisó hace más de 4 años

i want lab with python

PRUDHVEE R. · Se revisó hace más de 4 años

Victor G. · Se revisó hace más de 4 años

Great lab!

Cristóbal S. · Se revisó hace más de 4 años

solution doesn't work: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[85,10] cannot find symbol [ERROR] symbol: class ProcessElement [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[58,27] cannot find symbol [ERROR] symbol: variable PipelineOptionsFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[87,13] cannot find symbol [ERROR] symbol: class Gson [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[87,29] cannot find symbol [ERROR] symbol: class Gson [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[105,9] cannot find symbol [ERROR] symbol: class Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[105,29] cannot find symbol [ERROR] symbol: variable Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[106,16] cannot find symbol [ERROR] symbol: method setJobName(java.lang.String) [ERROR] location: variable options of type com.mypackage.pipeline.MyPipeline.Options [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[125,72] package BigQueryIO.Write does not exist [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[124,71] package BigQueryIO.Write does not exist [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[123,25] cannot find symbol [ERROR] symbol: variable BigQueryIO [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[121,37] cannot find symbol [ERROR] symbol: variable ParDo [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[120,39] cannot find symbol [ERROR] symbol: variable TextIO [ERROR] location: class com.mypackage.pipeline.MyPipeline

Mohammad G. · Se revisó hace más de 4 años

Thomas M. · Se revisó hace más de 4 años

Kavan D. · Se revisó hace más de 4 años

Great Lab!

Rajesh Reddy K. · Se revisó hace más de 4 años

Serhii K. · Se revisó hace más de 4 años

The environment was not provisioned. The directory were not set up, and I had many authorization issues.

Yannick Q. · Se revisó hace más de 4 años

Antonio A. · Se revisó hace más de 4 años

Antonio A. · Se revisó hace más de 4 años

Could not get the lab resources to work, the IDE was never ok so could not open it.

Mats W. · Se revisó hace más de 4 años

Aravind r. · Se revisó hace más de 4 años

Rahul H. · Se revisó hace más de 4 años

Ionel M. · Se revisó hace más de 4 años

Clicking on the console.cloud.google.com/dataflow/ link got me into trouble, because I wound up in a browser window for a different account and project. I didn't notice this until my dataflow parameterized job failed. Also, I followed the instructions for creating a schema.json file in Cloud Storage, but can't get the points for this step. Since I was able to see the file in Cloud Storage, and ultimately able to run the Dataflow job, I'm assuming that I did in fact successfully create the schema.json.

David V. · Se revisó hace más de 4 años

Sachin M. · Se revisó hace más de 4 años

ran out of time

Tony G. · Se revisó hace más de 4 años

Tony M. · Se revisó hace más de 4 años

Bharat M. · Se revisó hace casi 5 años

Florian R. · Se revisó hace casi 5 años

terrible lab

Piyush P. · Se revisó hace casi 5 años

getting error [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:java (default-cli) on project advanced-dataflow-lab-1-lab: An exception occured while executing the Java class. BigQueryIO.Write needs a GCS temp location to store temp files. -

Olga K. · Se revisó hace casi 5 años

I want Python, if available.

Steve V. · Se revisó hace casi 5 años