Opiniones sobre Procesamiento de datos sin servidores con Dataflow: Cómo escribir una canalización de ETL con Apache Beam y Dataflow (Java)

Jéssica Isri D. · Se revisó hace casi 4 años

ide problem

Manoj K. · Se revisó hace casi 4 años

Manoj K. · Se revisó hace casi 4 años

Eduardo D. · Se revisó hace casi 4 años

Ákos M. · Se revisó hace casi 4 años

There is something wrong with the 'Creating a JSON schema file' check. The file is correctly being generated and uploaded into the bucket but the check still doesn't shows up. Unable to finish due to this bug...

Eliseo F. · Se revisó hace casi 4 años

Dilu M. · Se revisó hace casi 4 años

Francesco C. · Se revisó hace casi 4 años

Very difficult to understand the lab......a video might be better instead of the written format

Bhavin K. · Se revisó hace casi 4 años

Marcelo S. · Se revisó hace casi 4 años

Sebabrata G. · Se revisó hace casi 4 años

It's a quest and not a lab. There is a bug in check performed for "creating a JSON schema file"

Onkar K. · Se revisó hace casi 4 años

It's a quest and not a lab. There is a bug in check performed for "creating a JSON schema file"

Onkar K. · Se revisó hace casi 4 años

It's a quest and not a lab

Onkar K. · Se revisó hace casi 4 años

Nobuhiro O. · Se revisó hace casi 4 años

Needs to be debugged, there is a dependency issue. I am struggling since not very handy with coding, especially Java. Also Qwiklabs team is taking a lot of time (days to resolve) [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project advanced-dataflow-lab-1-lab: Compilation failure: Compilation failure: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[19,23] package com.google.gson does not exist javac -classpath <LOCATION_TO_GSON JAR FILE> *.java

Vikas W. · Se revisó hace casi 4 años

Mohamed A. · Se revisó hace casi 4 años

Needs to be debugged

Vikas W. · Se revisó hace casi 4 años

Bug in description, bugs in scripts, and again solution does not include first stage with dump using Gson. Very poorly prepared.

Mariusz S. · Se revisó hace casi 4 años

Hoe Kit C. · Se revisó hace casi 4 años

[INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,26] cannot find symbol symbol: class Logger location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[33,38] cannot find symbol symbol: class DataflowPipelineOptions location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[65,19] cannot find symbol symbol: class PipelineResult location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,39] cannot find symbol symbol: variable LoggerFactory location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[46,27] cannot find symbol symbol: variable PipelineOptionsFactory location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,9] cannot find symbol symbol: class Pipeline location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,29] cannot find symbol symbol: variable Pipeline location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[69,16] cannot find symbol symbol: method setJobName(java.lang.String) location: variable options of type com.mypackage.pipeline.MyPipeline.Options [INFO] 8 errors [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 6.548 s [INFO] Finished at: 2022-05-01T12:01:08+00:00 [INFO] Final Memory: 39M/58M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project advanced-dataflow-lab-1-lab: Compilation failure: Compilation failure: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,26] cannot find symbol [ERROR] symbol: class Logger [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[33,38] cannot find symbol [ERROR] symbol: class DataflowPipelineOptions [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[65,19] cannot find symbol [ERROR] symbol: class PipelineResult [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,39] cannot find symbol [ERROR] symbol: variable LoggerFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[46,27] cannot find symbol [ERROR] symbol: variable PipelineOptionsFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,9] cannot find symbol [ERROR] symbol: class Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,29] cannot find symbol [ERROR] symbol: variable Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[69,16] cannot find symbol [ERROR] symbol: method setJobName(java.lang.String) [ERROR] location: variable options of type com.mypackage.pipeline.MyPipeline.Options [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project advanced-dataflow-lab-1-lab: Compilation failure at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:90) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.compiler.CompilationFailureException: Compilation failure at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:1220) at org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:187) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) ... 20 more [ERROR] [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException theia@eb75c3cda9fd:/home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs$

Nishanth V. · Se revisó hace casi 4 años

Requires more time to finish for those new to Beam and or Java

Prateek P. · Se revisó hace casi 4 años

Tawanda C. · Se revisó hace casi 4 años

venkata s. · Se revisó hace casi 4 años

OĞUZ K. · Se revisó hace casi 4 años