输出是Logstash管道的最后一个阶段，它将过滤器数据从输入日志发送到指定目标. Logstash提供多个输出插件，用于将过滤后的日志事件存储到各种不同的存储和搜索引擎.
Logstash可以存储已过滤的日志a 文件，Elasticsearch Engine，stdout，AWS CloudWatch，等. TCP，UDP，Websocket 等网络协议也可用于Logstash，用于将日志事件传输到远程存储系统.
在ELK堆栈中，用户使用Elasticsearch引擎存储日志事件.在下面的示例中，我们将为本地Elasticsearch引擎生成日志事件.
我们可以安装Elasticsearch输出插件使用以下命令.
>logstash-plugin install Logstash-output-elasticsearch
此配置文件包含一个Elasticsearch插件，它将输出事件存储在本地安装的Elasticsearch中.
input {
file {
path => "C:/tpwork/logstash/bin/log/input.log"
}
}
filter {
grok {
match => [ "message", "%{LOGLEVEL:loglevel} -
%{NOTSPACE:taskid} - %{NOTSPACE:logger} -
%{WORD:label}( - %{INT:duration:int})?" ]
}
if [logger] == "TRANSACTION_START" {
aggregate {
task_id => "%{taskid}"
code => "map['sql_duration'] = 0"
map_action => "create"
}
}
if [logger] == "SQL" {
aggregate {
task_id => "%{taskid}"
code => "map['sql_duration'] ||= 0 ;
map['sql_duration'] += event.get('duration')"
}
}
if [logger] == "TRANSACTION_END" {
aggregate {
task_id => "%{taskid}"
code => "event.set('sql_duration', map['sql_duration'])"
end_of_task => true
timeout => 120
}
}
mutate {
add_field => {"user" => "IT屋.com"}
}
}
output {
elasticsearch {
hosts => ["127.0.0.1:9200"]
}
}以下代码块显示输入日志数据.
INFO - 48566 - TRANSACTION_START - start INFO - 48566 - SQL - transaction1 - 320 INFO - 48566 - SQL - transaction1 - 200 INFO - 48566 - TRANSACTION_END - end
要在localhost启动Elasticsearch，您应该使用以下命令.
C:\elasticsearch\bin> elasticsearch
Elasticsearch准备就绪后，您可以在浏览器中输入以下网址进行检查.
http://localhost:9200/
以下代码块显示Elasticsearch在localhost的响应.
{
"name" : "Doctor Dorcas",
"cluster_name" : "elasticsearch",
"version" : {
"number" : "2.1.1",
"build_hash" : "40e2c53a6b6c2972b3d13846e450e66f4375bd71",
"build_timestamp" : "2015-12-15T13:05:55Z",
"build_snapshot" : false,
"lucene_version" : "5.3.1"
},
"tagline" : "You Know, for Search"
}注意 : 有关Elasticsearch的更多信息，您可以单击以下链接.
https://www.it1352.comhttps://www.tutorialspoint.com/elasticsearch/index.html
现在，使用上面提到的Logstash.conf运行Logstash
>Logstash –f Logstash.conf
在粘贴上述文本后输出日志，该文本将由Logstash存储在Elasticsearch中.您可以通过在浏览器中键入以下URL来检查存储的数据.
http://localhost:9200/logstash-2017.01.01/_search？pretty
这是JSON格式的数据存储在索引Logstash-2017.01.01中.
{
"took" : 20,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"hits" : {
"total" : 10,
"max_score" : 1.0,
"hits" : [ {
"_index" : "logstash-2017.01.01",
"_type" : "logs",
"_id" : "AVlZ9vF8hshdrGm02KOs",
"_score" : 1.0,
"_source":{
"duration":200,"path":"C:/tpwork/logstash/bin/log/input.log",
"@timestamp":"2017-01-01T12:17:49.140Z","loglevel":"INFO",
"logger":"SQL","@version":"1","host":"wcnlab-PC",
"label":"transaction1",
"message":" INFO - 48566 - SQL - transaction1 - 200\r",
"user":"IT屋.com","taskid":"48566","tags":[]
}
},
{
"_index" : "logstash-2017.01.01",
"_type" : "logs",
"_id" : "AVlZ9vF8hshdrGm02KOt",
"_score" : 1.0,
"_source":{
"sql_duration":520,"path":"C:/tpwork/logstash/bin/log/input.log",
"@timestamp":"2017-01-01T12:17:49.145Z","loglevel":"INFO",
"logger":"TRANSACTION_END","@version":"1","host":"wcnlab-PC",
"label":"end",
"message":" INFO - 48566 - TRANSACTION_END - end\r",
"user":"IT屋.com","taskid":"48566","tags":[]
}
}
}
}
