如何编写Logstash过滤器来过滤kafka主题 [英] How to write Logstash filter to filter kafka topics

查看:35
本文介绍了如何编写Logstash过滤器来过滤kafka主题的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我想使用 kafka 作为输入,使用 logstash 作为输出.我将几个主题输入到logstash,并希望根据主题进行过滤.我试着写这样的代码:

I want to use kafka as input and logstash as output. I will feed several topics into logstash, and want to filter according to topics. I tried to write the code like that:

input {
    kafka {
        bootstrap_servers => "localhost:9092"
        topics => ["test", "payment"]
      }
}

filter {
    if [topic] = "test" {
       //do something
    } else {
       //do something
    }
}

但似乎不起作用.

推荐答案

所以之前的两个答案都有道理,但都不正确.

So both former answers had truth in it but were not correct.

1.添加decorate_events:

    input {
        kafka {
            bootstrap_servers => "localhost:9092"
            topics => ["test", "payment"]
            decorate_events => true
        }
    }

  1. 寻找[kafka][topic]而不是[@metadata][kafka][topic]:

    filter {
      if [kafka][topic] = "test" {
       //do something
      } else {
       //do something
      }
    }

这篇关于如何编写Logstash过滤器来过滤kafka主题的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆