Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

not getting data even after creating dataflow from template thrice.

Kalaivani S. · Reviewed almost 4 years ago

KAREEP N. · Reviewed almost 4 years ago

Koh K. · Reviewed almost 4 years ago

Usman M. · Reviewed almost 4 years ago

The final part for the time series I was not able to do the custom query as it gave me this error com.google.analytics.lego.web.server.domain.common.exception.AuthenticationErrorException: errorId: [ 0a526603 ], Message: [ Backend error:[BigQuery error: ACCESS_DENIED, msg: ;Response status error: 16 Backend error message: [ACCESS_DENIED] debug=User 501194158547: IAM access denied errorProto=code: "ACCESS_DENIED" argument: "Project" argument: "qwiklabs-gcp-00-a8654f32ca09" argument: "User does not have bigquery.jobs.create permission in project qwiklabs-gcp-00-a8654f32ca09." at com.google.cloud.helix.common.PermissionDeniedException.forProject(PermissionDeniedException.java:71) at com.google.cloud.helix.server.auth.IamAuthorizer.lambda$authorizeProjectAccessInternal$0(IamAuthorizer.java:376) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:224) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:211) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:124) at com.google.common.context.ContextRunnable.runInContext(ContextRunnable.java:83) at io.grpc.Context.run(Context.java:536) at com.google.tracing.GenericContextCallback.runInInheritedContext(GenericContextCallback.java:75) at com.google.common.context.ContextRunnable.run(ContextRunnable.java:74) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Backend error status: bq_errors { error_code: ACCESS_DENIED safe_error_msg: "" } Backend Request Id: ;] ] at com.google.analytics.lego.web.server.infrastructure.backends.legoservice.LegoServiceExceptionHandler.getExceptionForBqErrors(LegoServiceExceptionHandler.java:416) at com.google.analytics.lego.web.server.infrastructure.backends.legoservice.LegoServiceExceptionHandler.maybeThrowException(LegoServiceExceptionHandler.java:225) at com.google.analytics.lego.web.server.infrastructure.backends.legoservice.LegoServiceExceptionHandler.maybeThrowException(LegoServiceExceptionHandler.java:142) at com.google.analytics.lego.web.server.infrastructure.backends.legoservice.LegoServiceClientImpl.lambda$getLegoConnectorSchema$0(LegoServiceClientImpl.java:49) at com.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.doTransform(AbstractTransformFuture.java:253) at com.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.doTransform(AbstractTransformFuture.java:243) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:124) at com.google.common.context.ContextRunnable.runInContext(ContextRunnable.java:83) at io.grpc.Context.run(Context.java:536) at com.google.tracing.GenericContextCallback.runInInheritedContext(GenericContextCallback.java:75) at com.google.common.context.ContextRunnable.run(ContextRunnable.java:74) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at com.google.apps.framework.server.AbstractThreadPoolModule$InitializingThreadFactory.lambda$newThread$0(AbstractThreadPoolModule.java:424) at com.google.apps.framework.server.NonBlockingThreadPoolModule$NonBlockingThreadFactory.lambda$newThread$0(NonBlockingThreadPoolModule.java:112) at java.base/java.lang.Thread.run(Unknown Source)

Clarence T. · Reviewed almost 4 years ago

good

Rishi K. · Reviewed almost 4 years ago

Penugonda A. · Reviewed almost 4 years ago

Krishna N. · Reviewed almost 4 years ago

Sankalp D. · Reviewed almost 4 years ago

Sukanya P. · Reviewed almost 4 years ago

Mariana V. · Reviewed almost 4 years ago

Zainab S. · Reviewed almost 4 years ago

SID C. · Reviewed almost 4 years ago

Step 3 never finished running. I might need to add more workers

Jacob S. · Reviewed almost 4 years ago

Matheus V. · Reviewed almost 4 years ago

Mohammed A. · Reviewed almost 4 years ago

queries do not copy seamlessly

Jack G. · Reviewed almost 4 years ago

Maksim M. · Reviewed almost 4 years ago

Brendan M. · Reviewed almost 4 years ago

MELVYN W. · Reviewed almost 4 years ago

Khushi S. · Reviewed almost 4 years ago

Khushi S. · Reviewed almost 4 years ago

Jose C. · Reviewed almost 4 years ago

Christian O. · Reviewed almost 4 years ago