Logstash:是否可以将文档保存在内存中? [英] Logstash: is it possible to save documents in memory?

问题描述

我正在尝试将数据保存在内存中，以便能够在过滤器部分中快速检索.确实，当我收到新文档时，我想检索以前的相关文档，以便计算一些新指标.

I am trying to save data in memory that I would be able to retrieve quickly in my filter part. Indeed, when i receive new documents i want to retrieve former documents related in order to compute some new metrics.

任何人都可以告诉我是否有可能，如果可以，我如何实现呢?

Can anyone tell me if it is possible and if yes how could I achieve that ?

非常感谢您.

乔

推荐答案

要实现此目标，最接近的方法是使用

The closest thing to achieve this would be to use the elasticsearch filter in order to query an ES cluster for some document or the unofficial memcached filter, which is probably more up to that task given the features of memcached.

尽管我不知道任何官方/非官方的redis或hazelcast过滤器，但这也是一种选择，因为它们都是缓存技术.

I'm not aware of any official/unofficial redis or hazelcast filters, though, but that would also be an option since they are both caching technologies.

您还应该查看现有的 metrics过滤器，这可能还会有所帮助，具体取决于您的用例，顺便说一句，如果您需要更精确的帮助，则应该详细说明.

You should also have a look at the existing metrics filter which might also be of some help depending on your use case, which, by the way, you should detail a bit more if you desire more precise help.

这篇关于Logstash:是否可以将文档保存在内存中?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！