超低磁盘水印[??%] [英] low disk watermark [??%] exceeded on

查看:105
本文介绍了超低磁盘水印[??%]的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我在开发机器(单个笔记本)中使用了Elasticsearch 1.4.4。一切都被设置为默认值,因为我没有更改任何设置。



当我启动它时,我通常会收到以下消息:



[pre> [2015-10-27 09:38:31,588] [INFO] [node] [Milan] version [1.4.4],pid [33932],build [c88f77f / 2015-02-19T13:05:36Z]
[2015-10-27 09:38:31,588] [INFO] [节] [米兰]初始化...
[2015-10-27 09 :38:31,592] [INFO] [plugins] [Milan] loading [],sites []
[2015-10-27 09:38:34,665] [INFO] [node] [Milan] b [2015-10-27 09:38:34,665] [INFO] [节] [米兰]开始...
[2015-10-27 09:38:34,849] [信息] [运输] [米兰] bound_address {inet [/ 0:0:0:0:0:0:0:0:9300]},publish_address {inet [/10.81.1.108:9300]}
[2015-10-27 09: 38:35,022] [INFO] [发现] [米兰] elasticsearch / DZqnmWIZRpapZY_TPkkMBw
[2015-10-27 09:38:38,787] [INFO] [cluster.service] [Milan] new_主人[米兰] [DZqnmWIZRpapZY_TPkkMBw] [THINKANDACT1301] [inet [/10.81.1.108:9300]],原因:zen-disco-join(elect_as_master)
[2015-10-27 09:38:38,908] [INFO ] [http] [Milan] bound_address {inet [/ 0:0:0:0:0:0:0:0:9200]},publish_address {inet [/10.81.1.108:9200]}
[2015 10-27 09:38:38,908] [INFO] [节] [米兰]开始
[2015-10-27 09:38:39,220] [信息] [网关] [米兰]恢复[4]进入cluster_state
[2015-10-27 09:39:08,801] [INFO] [cluster.routing.allocation.decider] [米兰]低磁盘水印[15%]超过[DZqnmWIZRpapZY_TPkkMBw] [米兰]免费: 58.6gb [12.6%],副本不会分配给这个节点
[2015-10-27 09:39:38,798] [INFO] [cluster.routing.allocation.decider] [Milan]低磁盘水印[ 15%]超过[DZqnmWIZRpapZY_TPkkMBw] [米兰]免费:58.6gb [12.6%],复制品不会分配给此节点
[2015-10-27 09:40:08,801] [INFO] [cluster。 routing.allocation.decider] [米兰]低盘水印[15%]超过[DZqnmWIZRpapZY_TPkkMBw] [米兰]免费:58.6gb [12.6%],副本不会被分配给这个节点
....
/ pre>

我看到很多这些低磁盘水印...超过...消息。我的情况出了什么问题?如何解决?谢谢!



更新



在此之前,我搜索了SO的相关帖子。我发现一个与高水印...有关,在这种情况下,磁盘空间很小。在我的情况下,我检查并且我的磁盘上仍然有56GB。



更新



根据Andrei Stefan的意见,我需要更改设置。我应该这样做:

  curl -XPUT localhost:9200 / _cluster / settings -d'{
transient:{
cluster.routing.allocation.disk.threshold_enabled:false
}
}'

还是有可以编辑的设置文件来设置?



谢谢!

解决方案

如果你喜欢我有很多磁盘,你可以调整水印设置:


cluster.routing.allocation.disk.watermark.low



控制低水印的磁盘使用情况。它默认为85%,这意味着ES不会在节点使用超过85%的磁盘时将新的分片分配给节点。它也可以设置为绝对字节值(如500mb),以防止ES分配碎片,如果小于配置的空间空间可用。



cluster.routing.allocation.disk.watermark.high



控制高水印。它默认为90%,意味着如果节点磁盘使用率高于90%,ES将尝试将分片重定位到另一个节点。它也可以设置为一个绝对字节值(类似于低水印),以便将分片重新定位一次小于节点上配置的空间量。


https:// www .elastic.co / guide / en / elasticsearch / reference / current / disk-allocator.html



请注意:


百分比值指使用的磁盘空间,而字节值是指可用磁盘空间。这可能是混乱的,因为它翻转了高低的意义。例如,将低水印设置为10gb,将高水印设置为5gb是有意义的,而不是其他方式。


在我的5TB磁盘上,我设置了:

 #/etc/elasticsearch/elasticsearch.yml 
cluster.routing。 allocation.disk.threshold_enabled:true
cluster.routing.allocation.disk.watermark.low:30gb
cluster.routing.allocation.disk.watermark.high:20gb


I use Elasticsearch 1.4.4 in my development machine (a single notebook). Everything is set as default because I never changed any settings.

When I start it, I usually get the following message:

[2015-10-27 09:38:31,588][INFO ][node                     ] [Milan] version[1.4.4], pid[33932], build[c88f77f/2015-02-19T13:05:36Z]
[2015-10-27 09:38:31,588][INFO ][node                     ] [Milan] initializing ...
[2015-10-27 09:38:31,592][INFO ][plugins                  ] [Milan] loaded [], sites []
[2015-10-27 09:38:34,665][INFO ][node                     ] [Milan] initialized
[2015-10-27 09:38:34,665][INFO ][node                     ] [Milan] starting ...
[2015-10-27 09:38:34,849][INFO ][transport                ] [Milan] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/10.81.1.108:9300]}
[2015-10-27 09:38:35,022][INFO ][discovery                ] [Milan] elasticsearch/DZqnmWIZRpapZY_TPkkMBw
[2015-10-27 09:38:38,787][INFO ][cluster.service          ] [Milan] new_master [Milan][DZqnmWIZRpapZY_TPkkMBw][THINKANDACT1301][inet[/10.81.1.108:9300]], reason: zen-disco-join (elected_as_master)
[2015-10-27 09:38:38,908][INFO ][http                     ] [Milan] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/10.81.1.108:9200]}
[2015-10-27 09:38:38,908][INFO ][node                     ] [Milan] started
[2015-10-27 09:38:39,220][INFO ][gateway                  ] [Milan] recovered [4] indices into cluster_state
[2015-10-27 09:39:08,801][INFO ][cluster.routing.allocation.decider] [Milan] low disk watermark [15%] exceeded on [DZqnmWIZRpapZY_TPkkMBw][Milan] free: 58.6gb[12.6%], replicas will not be assigned to this node
[2015-10-27 09:39:38,798][INFO ][cluster.routing.allocation.decider] [Milan] low disk watermark [15%] exceeded on [DZqnmWIZRpapZY_TPkkMBw][Milan] free: 58.6gb[12.6%], replicas will not be assigned to this node
[2015-10-27 09:40:08,801][INFO ][cluster.routing.allocation.decider] [Milan] low disk watermark [15%] exceeded on [DZqnmWIZRpapZY_TPkkMBw][Milan] free: 58.6gb[12.6%], replicas will not be assigned to this node
....

I see a lot of these "low disk watermark ... exceeded on..." messages. What went wrong in my case? How to fix it? Thanks!

UPDATE

Before this post, I searched SO for related posts. I found one related to "high watermark..." and in that case, the disk space is low. In my case, I checked and there is still 56GB left on my disk.

UPDATE

According to the input from Andrei Stefan, I need to change settings. Should I do it the following way:

curl -XPUT localhost:9200/_cluster/settings -d '{
    "transient" : {
        "cluster.routing.allocation.disk.threshold_enabled" : false
    }
}'

Or is there any settings file I can edit to set it?

Thanks!

解决方案

If you like me have a lot of disk you can tune the watermark setting:

cluster.routing.allocation.disk.watermark.low

Controls the low watermark for disk usage. It defaults to 85%, meaning ES will not allocate new shards to nodes once they have more than 85% disk used. It can also be set to an absolute byte value (like 500mb) to prevent ES from allocating shards if less than the configured amount of space is available.

And

cluster.routing.allocation.disk.watermark.high

Controls the high watermark. It defaults to 90%, meaning ES will attempt to relocate shards to another node if the node disk usage rises above 90%. It can also be set to an absolute byte value (similar to the low watermark) to relocate shards once less than the configured amount of space is available on the node.

https://www.elastic.co/guide/en/elasticsearch/reference/current/disk-allocator.html

Please note:

Percentage values refer to used disk space, while byte values refer to free disk space. This can be confusing, since it flips the meaning of high and low. For example, it makes sense to set the low watermark to 10gb and the high watermark to 5gb, but not the other way around.

On my 5TB disk I've set:

# /etc/elasticsearch/elasticsearch.yml
cluster.routing.allocation.disk.threshold_enabled: true
cluster.routing.allocation.disk.watermark.low: 30gb
cluster.routing.allocation.disk.watermark.high: 20gb

这篇关于超低磁盘水印[??%]的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆