리뷰 Dataflow를 사용한 서버리스 데이터 처리 - Apache Beam 및 Dataflow를 사용한 ETL 파이프라인 작성(Java)개

Maryna B. · 4년 초과 전에 리뷰됨

i want lab with python

PRUDHVEE R. · 4년 초과 전에 리뷰됨

Victor G. · 4년 초과 전에 리뷰됨

Great lab!

Cristóbal S. · 4년 초과 전에 리뷰됨

solution doesn't work: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[85,10] cannot find symbol [ERROR] symbol: class ProcessElement [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[58,27] cannot find symbol [ERROR] symbol: variable PipelineOptionsFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[87,13] cannot find symbol [ERROR] symbol: class Gson [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[87,29] cannot find symbol [ERROR] symbol: class Gson [ERROR] location: class com.mypackage.pipeline.MyPipeline.JsonToCommonLog [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[105,9] cannot find symbol [ERROR] symbol: class Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[105,29] cannot find symbol [ERROR] symbol: variable Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[106,16] cannot find symbol [ERROR] symbol: method setJobName(java.lang.String) [ERROR] location: variable options of type com.mypackage.pipeline.MyPipeline.Options [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[125,72] package BigQueryIO.Write does not exist [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[124,71] package BigQueryIO.Write does not exist [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[123,25] cannot find symbol [ERROR] symbol: variable BigQueryIO [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[121,37] cannot find symbol [ERROR] symbol: variable ParDo [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[120,39] cannot find symbol [ERROR] symbol: variable TextIO [ERROR] location: class com.mypackage.pipeline.MyPipeline

Mohammad G. · 4년 초과 전에 리뷰됨

Thomas M. · 4년 초과 전에 리뷰됨

Kavan D. · 4년 초과 전에 리뷰됨

Great Lab!

Rajesh Reddy K. · 4년 초과 전에 리뷰됨

Serhii K. · 4년 초과 전에 리뷰됨

The environment was not provisioned. The directory were not set up, and I had many authorization issues.

Yannick Q. · 4년 초과 전에 리뷰됨

Antonio A. · 4년 초과 전에 리뷰됨

Antonio A. · 4년 초과 전에 리뷰됨

Could not get the lab resources to work, the IDE was never ok so could not open it.

Mats W. · 4년 초과 전에 리뷰됨

Aravind r. · 4년 초과 전에 리뷰됨

Rahul H. · 4년 초과 전에 리뷰됨

Ionel M. · 4년 초과 전에 리뷰됨

Clicking on the console.cloud.google.com/dataflow/ link got me into trouble, because I wound up in a browser window for a different account and project. I didn't notice this until my dataflow parameterized job failed. Also, I followed the instructions for creating a schema.json file in Cloud Storage, but can't get the points for this step. Since I was able to see the file in Cloud Storage, and ultimately able to run the Dataflow job, I'm assuming that I did in fact successfully create the schema.json.

David V. · 4년 초과 전에 리뷰됨

Sachin M. · 4년 초과 전에 리뷰됨

ran out of time

Tony G. · 4년 초과 전에 리뷰됨

Tony M. · 4년 초과 전에 리뷰됨

Bharat M. · 거의 5년 전에 리뷰됨

Florian R. · 거의 5년 전에 리뷰됨

terrible lab

Piyush P. · 거의 5년 전에 리뷰됨

getting error [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:java (default-cli) on project advanced-dataflow-lab-1-lab: An exception occured while executing the Java class. BigQueryIO.Write needs a GCS temp location to store temp files. -

Olga K. · 거의 5년 전에 리뷰됨

I want Python, if available.

Steve V. · 거의 5년 전에 리뷰됨