从Logstash中的AWS S3输入路径提取字段 [英] Extracting fields from AWS S3 input paths in logstash

问题描述

是否可以根据存储段路径添加字段/标签?我尝试使用grok，但是没有用.

Is it possible to add fields/tags based on the bucket path? I tried to use grok but it didn't work.

推荐答案

使用Logstash 6.0.1，您将能够从S3获取每个文件的密钥(或路径).

With Logstash 6.0.1, you will be able to get key (or path) for each file from S3.

示例:

input {
    s3 {
        bucket => "<bucket-name>"
        prefix => "<prefix>"
    }
}

filter {
    mutate {
        add_field => {
            "file" => "%{[@metadata][s3][key]}"
        }
    }
    ...
}

参考: : 查看全文