Using BigQuery and Cloud Logging to Analyze BigQuery Usage Reviews

Ray L. · Reviewed almost 7 years ago

Brian T. · Reviewed almost 7 years ago

Hoang L. · Reviewed almost 7 years ago

Arnaldo P. · Reviewed almost 7 years ago

Hiếu N. · Reviewed almost 7 years ago

Eric K. · Reviewed almost 7 years ago

The most important query to pull the logs did not work even after making changes to the GCP Project ID as suggested. CREATE OR REPLACE VIEW bq_logs.v_querylogs AS SELECT resource.labels.project_id, protopayload_auditlog.authenticationInfo.principalEmail, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobConfiguration.query.query, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobConfiguration.query.statementType, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatus.error.message, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.startTime, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.endTime, TIMESTAMP_DIFF(protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.endTime, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.startTime, MILLISECOND)/1000 AS run_seconds, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.totalProcessedBytes, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.totalSlotMs, ARRAY(SELECT as STRUCT datasetid, tableId FROM UNNEST(protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.referencedTables)) as tables_ref, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.totalTablesProcessed, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.queryOutputRowCount, severity FROM `<YOUR-PROJECT-ID>.bq_logs.cloudaudit_googleapis_com_data_access_*` ORDER BY startTime

Kiran S. · Reviewed almost 7 years ago

Ignacio B. · Reviewed about 7 years ago

ok

gary l. · Reviewed about 7 years ago

Kashyap D. · Reviewed about 7 years ago

Sateesh K. · Reviewed about 7 years ago

Huy D. · Reviewed about 7 years ago

kumar b. · Reviewed about 7 years ago

Kenryo K. · Reviewed about 7 years ago

Corey R. · Reviewed about 7 years ago

satisfied

Tuấn Đ. · Reviewed about 7 years ago

bjorn r. · Reviewed about 7 years ago

Mayank C. · Reviewed about 7 years ago

NGUYEN V. · Reviewed about 7 years ago

Wyatt H. · Reviewed about 7 years ago

Lucas B. · Reviewed about 7 years ago

retu d. · Reviewed about 7 years ago

Kevin L. · Reviewed about 7 years ago

Dinh T. · Reviewed about 7 years ago

Mike L. · Reviewed about 7 years ago