ストリーミング データの処理: ストリーミング データ パイプライン のレビュー

godwin godwin · 6年以上前にレビュー済み

Wijayasundara Chaminda · 6年以上前にレビュー済み

Thompson Chris · 6年以上前にレビュー済み

Outdated instruction

Napassaporn Napassaporn · 6年以上前にレビュー済み

Gabriel Frigerio David · 6年以上前にレビュー済み

Nunez Emily · 6年以上前にレビュー済み

van Kempen Denys · 6年以上前にレビュー済み

Brinkmann Alex · 6年以上前にレビュー済み

Good

Vargas Lizcano Freddy Geovanny · 6年以上前にレビュー済み

Derry Phil · 6年以上前にレビュー済み

Eico Hayama Nishida Cyntia · 6年以上前にレビュー済み

Trivedi Dipen · 6年以上前にレビュー済み

Kulkarni Krishna · 6年以上前にレビュー済み

student-03-d151e523c11c@training-vm:~/training-data-analyst/courses/streaming/process/sandiego$ ./run_oncloud.sh cloud-training-demos cloud-training-demos CurrentConditions --bigtable Launching com.google.cloud.training.dataanalyst.sandiego.CurrentConditions project=cloud-training-demos bucket=cloud-training-demos --bigtable [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building sandiego [1.0.0,2.0.0] [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ sandiego --- [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /home/student-03-d151e523c11c/training-data-analyst/courses/streaming/process/sandiego/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ sandiego --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ sandiego --- Mar 05, 2020 2:16:01 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 134 files. Enable logging at DEBUG level to see which files will be staged. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.BigtableSession info INFO: Opening connection for projectId cloud-training-demos, instanceId sandiego, on data host bigtable.googleapis.com, admin host bigtableadmin.googleapis.com. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.BigtableSession info INFO: Bigtable options: BigtableOptions{dataHost=bigtable.googleapis.com, adminHost=bigtableadmin.googleapis.com, port=443, projectId=cloud-training-demos, instanceId=sandiego, appProfileId=, userAgent=cpb210, crede ntialType=SuppliedCredentials, dataChannelCount=4, retryOptions=RetryOptions{retriesEnabled=true, allowRetriesWithoutTimestamp=false, statusToRetryOn=[DEADLINE_EXCEEDED, UNAVAILABLE, UNAUTHENTICATED, ABORTED], initi alBackoffMillis=5, maxElapsedBackoffMillis=60000, backoffMultiplier=1.5, streamingBufferSize=60, readPartialRowTimeoutMillis=60000, maxScanTimeoutRetries=3}, bulkOptions=BulkOptions{asyncMutatorCount=2, useBulkApi=t rue, bulkMaxKeyCount=125, bulkMaxRequestSize=1048576, autoflushMs=0, maxInflightRpcs=40, maxMemory=94070374, enableBulkMutationThrottling=true, bulkMutationRpcTargetMs=100}, callOptionsConfig=CallOptionsConfig{useTi meout=false, shortRpcTimeoutMs=60000, longRpcTimeoutMs=600000}, usePlaintextNegotiation=false, useCachedDataPool=false, useBatch=false}. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.io.OAuthCredentialsCache info INFO: Refreshing the OAuth token Mar 05, 2020 2:16:04 PM com.google.cloud.bigtable.grpc.async.ResourceLimiter info INFO: Initializing BulkMutation throttling. Once latency is higher than 100 ms, parallelism will be reduced. Mar 05, 2020 2:16:05 PM com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation error SEVERE: Could not complete RPC. Failure #0, got: Status{code=PERMISSION_DENIED, description=Access denied. Missing IAM permission: bigtable.tables.get., cause=null} on channel 5. Trailers: Metadata(bigtable-channel-id=5) Mar 05, 2020 2:16:05 PM com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation error SEVERE: Could not complete RPC. Failure #0, got: Status{code=PERMISSION_DENIED, description=Access denied. Missing IAM permission: bigtable.tables.create., cause=null} on channel 5. Trailers: Metadata(bigtable-channel-id=5) [WARNING] io.grpc.StatusRuntimeException: PERMISSION_DENIED: Access denied. Missing IAM permission: bigtable.tables.create. at io.grpc.Status.asRuntimeException(Status.java:521) at com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation.getBlockingResult(AbstractRetryingOperation.java:442) at com.google.cloud.bigtable.grpc.BigtableTableAdminGrpcClient.createTable(BigtableTableAdminGrpcClient.java:171) at com.google.cloud.training.dataanalyst.sandiego.BigtableHelper.createEmptyTable(BigtableHelper.java:94) at com.google.cloud.training.dataanalyst.sandiego.BigtableHelper.writeToBigtable(BigtableHelper.java:70) at com.google.cloud.training.dataanalyst.sandiego.CurrentConditions.main(CurrentConditions.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Skorupskyi Maksym · 6年以上前にレビュー済み

Sanin Castro Paula · 6年以上前にレビュー済み

Landau Jack · 6年以上前にレビュー済み

Ray Anirban · 6年以上前にレビュー済み

cool

Vig Pawan · 6年以上前にレビュー済み

Cheleyeva Maral · 6年以上前にレビュー済み

Labarre Guillaume · 6年以上前にレビュー済み

Cheung Herman · 6年以上前にレビュー済み

arif sohail · 6年以上前にレビュー済み

Rajput Nidhi · 6年以上前にレビュー済み

Oliveira Andre · 6年以上前にレビュー済み

Only Java, no python

Malamud Ezequiel · 6年以上前にレビュー済み