Using BigQuery and Cloud Logging to Analyze BigQuery Usage Reviews

Ray L. · Reviewed כמעט 7 שנים ago

Brian T. · Reviewed כמעט 7 שנים ago

Hoang L. · Reviewed כמעט 7 שנים ago

Arnaldo P. · Reviewed כמעט 7 שנים ago

Hiếu N. · Reviewed כמעט 7 שנים ago

Eric K. · Reviewed כמעט 7 שנים ago

The most important query to pull the logs did not work even after making changes to the GCP Project ID as suggested. CREATE OR REPLACE VIEW bq_logs.v_querylogs AS SELECT resource.labels.project_id, protopayload_auditlog.authenticationInfo.principalEmail, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobConfiguration.query.query, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobConfiguration.query.statementType, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatus.error.message, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.startTime, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.endTime, TIMESTAMP_DIFF(protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.endTime, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.startTime, MILLISECOND)/1000 AS run_seconds, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.totalProcessedBytes, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.totalSlotMs, ARRAY(SELECT as STRUCT datasetid, tableId FROM UNNEST(protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.referencedTables)) as tables_ref, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.totalTablesProcessed, protopayload_auditlog.servicedata_v1_bigquery.jobCompletedEvent.job.jobStatistics.queryOutputRowCount, severity FROM `<YOUR-PROJECT-ID>.bq_logs.cloudaudit_googleapis_com_data_access_*` ORDER BY startTime

Kiran S. · Reviewed כמעט 7 שנים ago

Ignacio B. · Reviewed בערך 7 שנים ago

ok

gary l. · Reviewed בערך 7 שנים ago

Kashyap D. · Reviewed בערך 7 שנים ago

Sateesh K. · Reviewed בערך 7 שנים ago

Huy D. · Reviewed בערך 7 שנים ago

kumar b. · Reviewed בערך 7 שנים ago

Kenryo K. · Reviewed בערך 7 שנים ago

Corey R. · Reviewed בערך 7 שנים ago

satisfied

Tuấn Đ. · Reviewed בערך 7 שנים ago

bjorn r. · Reviewed בערך 7 שנים ago

Mayank C. · Reviewed בערך 7 שנים ago

NGUYEN V. · Reviewed בערך 7 שנים ago

Wyatt H. · Reviewed בערך 7 שנים ago

Lucas B. · Reviewed בערך 7 שנים ago

retu d. · Reviewed בערך 7 שנים ago

Kevin L. · Reviewed בערך 7 שנים ago

Dinh T. · Reviewed בערך 7 שנים ago

Mike L. · Reviewed בערך 7 שנים ago