记录所有BigQuery查询 [英] logging all BigQuery queries

问题描述

是否有可能将所有BigQuery请求记录到云存储中的文件（或者更好地写入BigQuery表中）？看起来bq中的--apilog选项主要用于调试目的，但我想要做的是跟踪所有查询，就像在CloudStorage中记录特定文件上的所有访问请求一样。

更具体地说，我不只是想记录我自己的查询，而是（a）同一个项目中的所有用户进行查询，并且最优的还有（b） em> everyone 触摸我拥有的数据集中的表格。 我知道它晚了，但是GCP in其最新版本引入了审计日志的这一新功能。

请参阅此 - 审核日志BQ a>

Is it possible to have all BigQuery requests logged to a file in Cloud Storage (or even better into a BigQuery table)? It seems like the --apilog option available in bq is intended mainly for debugging purposes, but what I'd like to do is keep track of all queries, just like logging all access requests on a particular file in CloudStorage.

To be more specific, I don't just want to log my own queries, but (a) queries by all users within the same project, and optimally also (b) queries by anyone touching a table in a dataset that I own.

解决方案

I know its late, but GCP in its latest releases introduced this new feature of Audit logs.

Refer this - Audit Logs BQ

这篇关于记录所有BigQuery查询的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！