Traitement de données sans serveur avec Dataflow : écrire un pipeline ETL à l'aide d'Apache Beam et de Dataflow (Java) avis

Balaji M. · Examiné il y a plus de 4 ans

suryavamshi t. · Examiné il y a plus de 4 ans

Maryna B. · Examiné il y a plus de 4 ans

i want lab with python

PRUDHVEE R. · Examiné il y a plus de 4 ans

Victor G. · Examiné il y a plus de 4 ans

Great lab!

Cristóbal S. · Examiné il y a plus de 4 ans

solution doesn't work: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[85,10] cannot find symbol [ERROR] symbol: class ProcessElement [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[58,27] cannot find symbol [ERROR] symbol: variable PipelineOptionsFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[87,13] cannot find symbol [ERROR] symbol: class Gson [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[87,29] cannot find symbol [ERROR] symbol: class Gson [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[105,9] cannot find symbol [ERROR] symbol: class Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[105,29] cannot find symbol [ERROR] symbol: variable Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[106,16] cannot find symbol [ERROR] symbol: method setJobName(java.lang.String) [ERROR] location: variable options of type com.mypackage.pipeline.MyPipeline.Options [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[125,72] package BigQueryIO.Write does not exist [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[124,71] package BigQueryIO.Write does not exist [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[123,25] cannot find symbol [ERROR] symbol: variable BigQueryIO [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[121,37] cannot find symbol [ERROR] symbol: variable ParDo [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[120,39] cannot find symbol [ERROR] symbol: variable TextIO [ERROR] location: class com.mypackage.pipeline.MyPipeline

Mohammad G. · Examiné il y a plus de 4 ans

Thomas M. · Examiné il y a plus de 4 ans

Kavan D. · Examiné il y a plus de 4 ans

Great Lab!

Rajesh Reddy K. · Examiné il y a plus de 4 ans

Serhii K. · Examiné il y a plus de 4 ans

The environment was not provisioned. The directory were not set up, and I had many authorization issues.

Yannick Q. · Examiné il y a plus de 4 ans

Antonio A. · Examiné il y a plus de 4 ans

Antonio A. · Examiné il y a plus de 4 ans

Could not get the lab resources to work, the IDE was never ok so could not open it.

Mats W. · Examiné il y a plus de 4 ans

Aravind r. · Examiné il y a plus de 4 ans

Rahul H. · Examiné il y a plus de 4 ans

Ionel M. · Examiné il y a plus de 4 ans

Clicking on the console.cloud.google.com/dataflow/ link got me into trouble, because I wound up in a browser window for a different account and project. I didn't notice this until my dataflow parameterized job failed. Also, I followed the instructions for creating a schema.json file in Cloud Storage, but can't get the points for this step. Since I was able to see the file in Cloud Storage, and ultimately able to run the Dataflow job, I'm assuming that I did in fact successfully create the schema.json.

David V. · Examiné il y a plus de 4 ans

Sachin M. · Examiné il y a plus de 4 ans

ran out of time

Tony G. · Examiné il y a plus de 4 ans

Tony M. · Examiné il y a plus de 4 ans

Bharat M. · Examiné il y a plus de 4 ans

Florian R. · Examiné il y a plus de 4 ans

terrible lab

Piyush P. · Examiné il y a plus de 4 ans