成功加载数据后，sstableloader不会退出 [英] sstableloader does not exit after successful data loading

问题描述

我正在尝试将数据批量加载到DSE中，但是sstableloader在成功运行后不会退出。根据输出，每个节点的进度已经是100％，进度总计也显示为100％

I'm trying to bulk-load my data into DSE but sstableloader doesn't exit after a successful run. According to the output, the progress for each node is already 100% and the progress total also shows 100%

• 环境：CentOS 6.x x86_64; DSE 4.0.1


• 拓扑：1个Cassandra节点，5个Solr节点（DC由DSE自动分配）； RF 2


• 每个DSE节点中的系统ulimit（硬，软）：65536


• sstabletableloader堆大小（-Xmx）：10240M（10G）


• SSTables大小：158gb（来自80gb CSV，241m行）

• Environment: CentOS 6.x x86_64; DSE 4.0.1
• Topology: 1 Cassandra node, 5 Solr nodes (DC auto-assigned by DSE); RF 2
• System ulimit (hard, soft) in each DSE node: 65536
• sstableloader heap size (-Xmx): 10240M (10G)
• SSTables size: 158gb (from 80gb CSV, 241m rows)

我尝试删除所有节点-希望当一个或多个节点出现故障时sstableloader会以某种方式退出-但事实并非如此。我必须通过 kill命令或命令窗口（SIGINT）中的CTRL + C手动终止该过程。

I tried to take down all nodes - hoping that sstableloader would somehow exit when one or more nodes go down - but it didn't. I had to kill the process manually either by 'kill' command or CTRL+C in the command window (SIGINT).

在遇到sstableloader不退出的问题之前，我已经成功退出了1次。我再也无法复制了，因为无论sstables的大小如何，sstableloader都会在所有后续尝试中拒绝退出

Prior to experiencing this issue with sstableloader not exiting, I had 1 successful run where it exited. I can't reproduce that anymore because sstableloader refuses to exit in all of my subsequent attempts regardless of sstables size

推荐答案

二级索引需要也要建造。但这不应该花几个小时。

Secondary indexes need to be built as well. But that shouldn't take hours.

这篇关于成功加载数据后，sstableloader不会退出的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！