Processamento de dados de streaming: pipelines de dados de streaming avaliações

godwin g. · Revisado há over 6 years

Chaminda W. · Revisado há over 6 years

Chris T. · Revisado há over 6 years

Outdated instruction

Napassaporn N. · Revisado há over 6 years

David G. · Revisado há over 6 years

Emily N. · Revisado há over 6 years

Denys v. · Revisado há over 6 years

Alex B. · Revisado há over 6 years

Good

Freddy Geovanny V. · Revisado há over 6 years

Phil D. · Revisado há over 6 years

Cyntia E. · Revisado há over 6 years

Dipen T. · Revisado há over 6 years

Krishna K. · Revisado há over 6 years

student-03-d151e523c11c@training-vm:~/training-data-analyst/courses/streaming/process/sandiego$ ./run_oncloud.sh cloud-training-demos cloud-training-demos CurrentConditions --bigtable Launching com.google.cloud.training.dataanalyst.sandiego.CurrentConditions project=cloud-training-demos bucket=cloud-training-demos --bigtable [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building sandiego [1.0.0,2.0.0] [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ sandiego --- [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /home/student-03-d151e523c11c/training-data-analyst/courses/streaming/process/sandiego/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ sandiego --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ sandiego --- Mar 05, 2020 2:16:01 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 134 files. Enable logging at DEBUG level to see which files will be staged. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.BigtableSession info INFO: Opening connection for projectId cloud-training-demos, instanceId sandiego, on data host bigtable.googleapis.com, admin host bigtableadmin.googleapis.com. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.BigtableSession info INFO: Bigtable options: BigtableOptions{dataHost=bigtable.googleapis.com, adminHost=bigtableadmin.googleapis.com, port=443, projectId=cloud-training-demos, instanceId=sandiego, appProfileId=, userAgent=cpb210, crede ntialType=SuppliedCredentials, dataChannelCount=4, retryOptions=RetryOptions{retriesEnabled=true, allowRetriesWithoutTimestamp=false, statusToRetryOn=[DEADLINE_EXCEEDED, UNAVAILABLE, UNAUTHENTICATED, ABORTED], initi alBackoffMillis=5, maxElapsedBackoffMillis=60000, backoffMultiplier=1.5, streamingBufferSize=60, readPartialRowTimeoutMillis=60000, maxScanTimeoutRetries=3}, bulkOptions=BulkOptions{asyncMutatorCount=2, useBulkApi=t rue, bulkMaxKeyCount=125, bulkMaxRequestSize=1048576, autoflushMs=0, maxInflightRpcs=40, maxMemory=94070374, enableBulkMutationThrottling=true, bulkMutationRpcTargetMs=100}, callOptionsConfig=CallOptionsConfig{useTi meout=false, shortRpcTimeoutMs=60000, longRpcTimeoutMs=600000}, usePlaintextNegotiation=false, useCachedDataPool=false, useBatch=false}. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.io.OAuthCredentialsCache info INFO: Refreshing the OAuth token Mar 05, 2020 2:16:04 PM com.google.cloud.bigtable.grpc.async.ResourceLimiter info INFO: Initializing BulkMutation throttling. Once latency is higher than 100 ms, parallelism will be reduced. Mar 05, 2020 2:16:05 PM com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation error SEVERE: Could not complete RPC. Failure #0, got: Status{code=PERMISSION_DENIED, description=Access denied. Missing IAM permission: bigtable.tables.get., cause=null} on channel 5. Trailers: Metadata(bigtable-channel-id=5) Mar 05, 2020 2:16:05 PM com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation error SEVERE: Could not complete RPC. Failure #0, got: Status{code=PERMISSION_DENIED, description=Access denied. Missing IAM permission: bigtable.tables.create., cause=null} on channel 5. Trailers: Metadata(bigtable-channel-id=5) [WARNING] io.grpc.StatusRuntimeException: PERMISSION_DENIED: Access denied. Missing IAM permission: bigtable.tables.create. at io.grpc.Status.asRuntimeException(Status.java:521) at com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation.getBlockingResult(AbstractRetryingOperation.java:442) at com.google.cloud.bigtable.grpc.BigtableTableAdminGrpcClient.createTable(BigtableTableAdminGrpcClient.java:171) at com.google.cloud.training.dataanalyst.sandiego.BigtableHelper.createEmptyTable(BigtableHelper.java:94) at com.google.cloud.training.dataanalyst.sandiego.BigtableHelper.writeToBigtable(BigtableHelper.java:70) at com.google.cloud.training.dataanalyst.sandiego.CurrentConditions.main(CurrentConditions.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Maksym S. · Revisado há over 6 years

Paula S. · Revisado há over 6 years

Jack L. · Revisado há over 6 years

Anirban R. · Revisado há over 6 years

cool

Pawan V. · Revisado há over 6 years

Maral C. · Revisado há over 6 years

Guillaume L. · Revisado há over 6 years

Herman C. · Revisado há over 6 years

sohail a. · Revisado há over 6 years

Nidhi R. · Revisado há over 6 years

Andre O. · Revisado há over 6 years

Only Java, no python

Ezequiel M. · Revisado há over 6 years