如何编写Logstash过滤器以过滤kafka主题 [英] How to write Logstash filter to filter kafka topics

问题描述

我想使用kafka作为输入，并使用logstash作为输出.我将几个主题输入logstash，并希望根据主题进行过滤.我试图写这样的代码:

I want to use kafka as input and logstash as output. I will feed several topics into logstash, and want to filter according to topics. I tried to write the code like that:

input {
    kafka {
        bootstrap_servers => "localhost:9092"
        topics => ["test", "payment"]
      }
}

filter {
    if [topic] = "test" {
       //do something
    } else {
       //do something
    }
}

但是似乎不起作用.

推荐答案

通过添加decorate_events以添加kafka字段来更改输入部分.

Change input part by adding decorate_events to add kafka field.

input {
    kafka {
        bootstrap_servers => "localhost:9092"
        topics => ["test", "payment"]
        decorate_events => true
    }
}

按如下所述更改过滤器部分:

Change filter part as follow:

filter {
    if [@metadata][kafka][topic] == "test" {
        //do something
    } else {
        //do something
  }
}

这篇关于如何编写Logstash过滤器以过滤kafka主题的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！