리뷰 스트리밍 데이터 처리: 스트리밍 데이터 파이프라인개

godwin g. · 6년 초과 전에 리뷰됨

Chaminda W. · 6년 초과 전에 리뷰됨

Chris T. · 6년 초과 전에 리뷰됨

Outdated instruction

Napassaporn N. · 6년 초과 전에 리뷰됨

David G. · 6년 초과 전에 리뷰됨

Emily N. · 6년 초과 전에 리뷰됨

Denys v. · 6년 초과 전에 리뷰됨

Alex B. · 6년 초과 전에 리뷰됨

Good

Freddy Geovanny V. · 6년 초과 전에 리뷰됨

Phil D. · 6년 초과 전에 리뷰됨

Cyntia E. · 6년 초과 전에 리뷰됨

Dipen T. · 6년 초과 전에 리뷰됨

Krishna K. · 6년 초과 전에 리뷰됨

student-03-d151e523c11c@training-vm:~/training-data-analyst/courses/streaming/process/sandiego$ ./run_oncloud.sh cloud-training-demos cloud-training-demos CurrentConditions --bigtable Launching com.google.cloud.training.dataanalyst.sandiego.CurrentConditions project=cloud-training-demos bucket=cloud-training-demos --bigtable [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building sandiego [1.0.0,2.0.0] [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ sandiego --- [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /home/student-03-d151e523c11c/training-data-analyst/courses/streaming/process/sandiego/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ sandiego --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ sandiego --- Mar 05, 2020 2:16:01 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 134 files. Enable logging at DEBUG level to see which files will be staged. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.BigtableSession info INFO: Opening connection for projectId cloud-training-demos, instanceId sandiego, on data host bigtable.googleapis.com, admin host bigtableadmin.googleapis.com. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.BigtableSession info INFO: Bigtable options: BigtableOptions{dataHost=bigtable.googleapis.com, adminHost=bigtableadmin.googleapis.com, port=443, projectId=cloud-training-demos, instanceId=sandiego, appProfileId=, userAgent=cpb210, crede ntialType=SuppliedCredentials, dataChannelCount=4, retryOptions=RetryOptions{retriesEnabled=true, allowRetriesWithoutTimestamp=false, statusToRetryOn=[DEADLINE_EXCEEDED, UNAVAILABLE, UNAUTHENTICATED, ABORTED], initi alBackoffMillis=5, maxElapsedBackoffMillis=60000, backoffMultiplier=1.5, streamingBufferSize=60, readPartialRowTimeoutMillis=60000, maxScanTimeoutRetries=3}, bulkOptions=BulkOptions{asyncMutatorCount=2, useBulkApi=t rue, bulkMaxKeyCount=125, bulkMaxRequestSize=1048576, autoflushMs=0, maxInflightRpcs=40, maxMemory=94070374, enableBulkMutationThrottling=true, bulkMutationRpcTargetMs=100}, callOptionsConfig=CallOptionsConfig{useTi meout=false, shortRpcTimeoutMs=60000, longRpcTimeoutMs=600000}, usePlaintextNegotiation=false, useCachedDataPool=false, useBatch=false}. Mar 05, 2020 2:16:03 PM com.google.cloud.bigtable.grpc.io.OAuthCredentialsCache info INFO: Refreshing the OAuth token Mar 05, 2020 2:16:04 PM com.google.cloud.bigtable.grpc.async.ResourceLimiter info INFO: Initializing BulkMutation throttling. Once latency is higher than 100 ms, parallelism will be reduced. Mar 05, 2020 2:16:05 PM com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation error SEVERE: Could not complete RPC. Failure #0, got: Status{code=PERMISSION_DENIED, description=Access denied. Missing IAM permission: bigtable.tables.get., cause=null} on channel 5. Trailers: Metadata(bigtable-channel-id=5) Mar 05, 2020 2:16:05 PM com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation error SEVERE: Could not complete RPC. Failure #0, got: Status{code=PERMISSION_DENIED, description=Access denied. Missing IAM permission: bigtable.tables.create., cause=null} on channel 5. Trailers: Metadata(bigtable-channel-id=5) [WARNING] io.grpc.StatusRuntimeException: PERMISSION_DENIED: Access denied. Missing IAM permission: bigtable.tables.create. at io.grpc.Status.asRuntimeException(Status.java:521) at com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation.getBlockingResult(AbstractRetryingOperation.java:442) at com.google.cloud.bigtable.grpc.BigtableTableAdminGrpcClient.createTable(BigtableTableAdminGrpcClient.java:171) at com.google.cloud.training.dataanalyst.sandiego.BigtableHelper.createEmptyTable(BigtableHelper.java:94) at com.google.cloud.training.dataanalyst.sandiego.BigtableHelper.writeToBigtable(BigtableHelper.java:70) at com.google.cloud.training.dataanalyst.sandiego.CurrentConditions.main(CurrentConditions.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Maksym S. · 6년 초과 전에 리뷰됨

Paula S. · 6년 초과 전에 리뷰됨

Jack L. · 6년 초과 전에 리뷰됨

Anirban R. · 6년 초과 전에 리뷰됨

cool

Pawan V. · 6년 초과 전에 리뷰됨

Maral C. · 6년 초과 전에 리뷰됨

Guillaume L. · 6년 초과 전에 리뷰됨

Herman C. · 6년 초과 전에 리뷰됨

sohail a. · 6년 초과 전에 리뷰됨

Nidhi R. · 6년 초과 전에 리뷰됨

Andre O. · 6년 초과 전에 리뷰됨

Only Java, no python

Ezequiel M. · 6년 초과 전에 리뷰됨