将旧日志从 Stackdriver 导出到 Bigquery [英] Exporting old logs from Stackdriver to Bigquery

问题描述

我有可追溯到 9 月 3 日的 Stackdriver 日志，以及我在 9 月 14 日创建的接收器，将这些日志拉入 Bigquery 数据集.目前，Bigquery 中的数据仅从我创建接收器时开始.我可以将以前的日志导出到一个巨大的 .csv 然后重新上传吗?我发现这里有一个类似的问题，但没有答案.

I have Stackdriver logs dating back to Sept. 3rd, and a sink I created on Sept. 14th pulling those logs into a Bigquery dataset. Currently, the data in Bigquery starts only from when I created the sink. Can I export previous logs to a giant .csv and then reupload? I found a similar question here, but with no answer.

谢谢，很抱歉我的问题没有更技术化——我是 Stackdriver 日志记录的新手！

Thanks, and sorry for not being more technical with my question -- I am new to Stackdriver logging!

推荐答案

截至 2021 年底，一个名为 复制日志 可用，这将允许您将旧日志转储到 GCS 存储桶中，然后从那里返回 BigQuery.

As of late 2021, an alpha feature known as copy logs is available, which will allow you to dump older logs into a GCS storage bucket, and from there, it's a short trip back into BigQuery.

需要注意的是，这必须通过 shell 完成，并且作为 alpha 功能，不提供任何保证或 SLA.

As a caveat, this must be done via shell, and as an alpha feature, no guarantees or SLAs are made.

在此功能出现之前，您可能会走运.下载旧日志每个请求只允许 10K 日志.

Prior to this feature, you would have been out of luck. Downloading old logs only allowed 10K logs per request.

这篇关于将旧日志从 Stackdriver 导出到 Bigquery的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！