Cassandra异常在修复期间 [英] Cassandra exceptions during repair

问题描述

我在运行nodetool修复时遇到cassandra的问题。

我在每个Cassandra节点上运行了一个nodetool修复，遇到下面提到的异常。

在做了一些阅读后，我运行了一个nodetool scrub和sstablescrub没有成功，我仍然看到相同的错误，当运行nodetool修复。 >

我们使用的是cassandra版本2.0.1。

有没有人看到这个问题？

 错误[AntiEntropySessions：3] 2013-11-26 15：25：03,315 RepairSession.java（line 278）[repair＃f9f86700-56f1-11e3-9885 -5938b4e97c9c]会话完成时出现以下错误
 org.apache.cassandra.exceptions.RepairException：[repair＃f9f86700-56f1-11e3-9885-5938b4e97c9c on< keyspace> /< table-1& 3566327001497837731，-3559225618918749690]]在org.apache.cassandra.repair.RepairSession.validationComplete（RepairSession.java:152）中的/< ipaddress-1> 
中的验证失败
 at org.apache.cassandra。 service.ActiveRepairService.handleMessage（ActiveRepairService.java:188）
在org.apache.cassandra.repair.RepairMessageVerbHandler.doVerb（RepairMessageVerbHandler.java:59）
在org.apache.cassandra.net.MessageDeliveryTask。运行（MessageDeliveryTask.java:56）
在java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）
在java.util.concurrent.ThreadPoolExecutor $ Worker.run（ThreadPoolExecutor.java： 615）
在java.lang.Thread.run（Thread.java:744）
错误[AntiEntropySessions：3] 2013-11-26 15：25：03,315 CassandraDaemon.java（行185）异常线程线程[AntiEntropySessions：3,5，RMI Runtime] 
 java.lang.RuntimeException：org.apache.cassandra.exceptions.RepairException：[repair＃f9f86700-56f1-11e3-9885-5938b4e97c9c on< keyspace> / < table-1>，（-3566327001497837731，-3559225618918749690]]验证失败在/< ipaddress-1> 
 at com.google.common.base.Throwables.propagate（Throwables.java:160）
 at org.apache.cassandra.utils.WrappedRunnable.run（WrappedRunnable.java:32）
在java.util.concurrent.Executors $ RunnableAdapter.call（Executors.java:471）
在java.util.concurrent.FutureTask.run（FutureTask.java:262）
在java.util.concurrent .ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）
在java.util.concurrent.ThreadPoolExecutor $ Worker.run（ThreadPoolExecutor.java:615）
在java.lang.Thread.run（Thread.java ：744）
 Caused by：org.apache.cassandra.exceptions.RepairException：[repair＃f9f86700-56f1-11e3-9885-5938b4e97c9c on< keyspace> /< table-1> ;,（-3566327001497837731， 3559225618918749690]]验证失败在/< ipaddress-1> 
 at org.apache.cassandra.repair.RepairSession.validationComplete（RepairSession.java:152）
 at org.apache.cassandra.service.ActiveRepairService .handleMessage（ActiveRepairService.java:188）
在org.apache.cassandra.repair.RepairMessageVerbHandler.doVerb（RepairMessageVerbHandler.java:59）
在org.apache.cassandra.net.MessageDeliveryTask.run（MessageDeliveryTask .java：56）
 ... 3 more 
 INFO [AntiEntropySessions：4] 2013-11-26 15：25：03,319 RepairSession.java（line 236）[repair＃fa075b20-56f1-11e3- 9885-5938b4e97c9c]新会话：将同步/< ipaddress1>，/< ipaddress2>，/< ipaddress3>关于< keyspace>。[< table-1>，< table-2>，< table-3>，< table-4>，< table-5>]的$ on范围（2637939872511762724,2642446772090452246） b $ b INFO [AntiEntropySessions：4] 2013-11-26 15：25：03,319 RepairJob.java（行116）[修复＃fa075b20-56f1-11e3-9885-5938b4e97c9c]请求用于< table-2>的merkle树到[/< ipaddress1>，< ipaddress2>，< ipaddress3>]）
 ERROR [ValidationExecutor：5] 2013-11-26 15：25：03,353 Validator.java tree for [repair＃f9f86700-56f1-11e3-9885-5938b4e97c9c on< keyspace> /< table-1>，（-3566327001497837731，-3559225618918749690]]，/< ipaddress-2>（详见日志）
 ERROR [ValidationExecutor：5] 2013-11-26 15：25：03,353 CassandraDaemon.java（第185行）线程中的异常Thread [ValidationExecutor：5,1，main] 
 java.lang.AssertionError 
 at org.apache.cassandra.db.compaction.PrecompactedRow.update（PrecompactedRow.java:171）
 at org.apache.cassandra.repair.Validator.rowHash（Validator.java:198）
在org.apache.cassandra.repair.Validator.add（Validator.java:151）
在org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction（CompactionManager.java:798）
在org .apache.cassandra.db.compaction.CompactionManager.access $ 600（CompactionManager.java:60）
 at org.apache.cassandra.db.compaction.CompactionManager $ 8.call（CompactionManager.java:395）
在java.util.concurrent.FutureTask.run（FutureTask.java:262）
在java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）
 at java.util.concurrent.ThreadPoolExecutor $ Worker.run（ThreadPoolExecutor.java:615）
 at java.lang.Thread.run（Thread.java:744）
  

解决方案

根据您的数据模型，您可能会看到效果CASSANDRA-6152。有关详情，请参阅此评论：

https://issues.apache.org/jira/browse/CASSANDRA-6152?focusedCommentId=13793977&page= com.atlassian.jira.plugin.system.issuetabpanels：comment-tabpanel＃comment-13793977

无论如何，你应该立即更新到2.0.3是几个其他相当严重的bug潜伏在您当前的版本。

I am currently having issues with cassandra when running a nodetool repair.

I ran a nodetool repair on each of our cassandra nodes and came across the exception mentioned below.

After doing some reading I ran a "nodetool scrub" and "sstablescrub" with no success, I am still seeing the same errors when running a nodetool repair.

We are using cassandra version 2.0.1.

Has anyone else seen this problem?

ERROR [AntiEntropySessions:3] 2013-11-26 15:25:03,315 RepairSession.java (line 278) [repair #f9f86700-56f1-11e3-9885-5938b4e97c9c] session completed with the following error
org.apache.cassandra.exceptions.RepairException: [repair #f9f86700-56f1-11e3-9885-5938b4e97c9c on <keyspace>/<table-1>, (-3566327001497837731,-3559225618918749690]] Validation failed in /<ipaddress-1>
        at org.apache.cassandra.repair.RepairSession.validationComplete(RepairSession.java:152)
        at org.apache.cassandra.service.ActiveRepairService.handleMessage(ActiveRepairService.java:188)
        at org.apache.cassandra.repair.RepairMessageVerbHandler.doVerb(RepairMessageVerbHandler.java:59)
        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:56)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
ERROR [AntiEntropySessions:3] 2013-11-26 15:25:03,315 CassandraDaemon.java (line 185) Exception in thread Thread[AntiEntropySessions:3,5,RMI Runtime]
java.lang.RuntimeException: org.apache.cassandra.exceptions.RepairException: [repair #f9f86700-56f1-11e3-9885-5938b4e97c9c on <keyspace>/<table-1>, (-3566327001497837731,-3559225618918749690]] Validation failed in /<ipaddress-1>
        at com.google.common.base.Throwables.propagate(Throwables.java:160)
        at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:32)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.cassandra.exceptions.RepairException: [repair #f9f86700-56f1-11e3-9885-5938b4e97c9c on <keyspace>/<table-1>, (-3566327001497837731,-3559225618918749690]] Validation failed in /<ipaddress-1>
        at org.apache.cassandra.repair.RepairSession.validationComplete(RepairSession.java:152)
        at org.apache.cassandra.service.ActiveRepairService.handleMessage(ActiveRepairService.java:188)
        at org.apache.cassandra.repair.RepairMessageVerbHandler.doVerb(RepairMessageVerbHandler.java:59)
        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:56)
        ... 3 more
 INFO [AntiEntropySessions:4] 2013-11-26 15:25:03,319 RepairSession.java (line 236) [repair #fa075b20-56f1-11e3-9885-5938b4e97c9c] new session: will sync /<ipaddress1>, /<ipaddress2>, /<ipaddress3> on range (2637939872511762724,2642446772090452246] for <keyspace>.[<table-1>, <table-2>, <table-3>, <table-4>, <table-5>]
 INFO [AntiEntropySessions:4] 2013-11-26 15:25:03,319 RepairJob.java (line 116) [repair #fa075b20-56f1-11e3-9885-5938b4e97c9c] requesting merkle trees for <table-2> (to [/<ipaddress1>, <ipaddress2>, <ipaddress3>])
ERROR [ValidationExecutor:5] 2013-11-26 15:25:03,353 Validator.java (line 242) Failed creating a merkle tree for [repair #f9f86700-56f1-11e3-9885-5938b4e97c9c on <keyspace>/<table-1>, (-3566327001497837731,-3559225618918749690]], /<ipaddress-2> (see log for details)
ERROR [ValidationExecutor:5] 2013-11-26 15:25:03,353 CassandraDaemon.java (line 185) Exception in thread Thread[ValidationExecutor:5,1,main]
java.lang.AssertionError
        at org.apache.cassandra.db.compaction.PrecompactedRow.update(PrecompactedRow.java:171)
        at org.apache.cassandra.repair.Validator.rowHash(Validator.java:198)
        at org.apache.cassandra.repair.Validator.add(Validator.java:151)
        at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:798)
        at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:60)
        at org.apache.cassandra.db.compaction.CompactionManager$8.call(CompactionManager.java:395)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)

解决方案

Depending on your data model, you may be seeing the effects CASSANDRA-6152. See this comment for details:

https://issues.apache.org/jira/browse/CASSANDRA-6152?focusedCommentId=13793977&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13793977

Regardless, you should update to 2.0.3 immediately as there are several other fairly severe bugs lurking on your current version.

这篇关于Cassandra异常在修复期间的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！