Cassandra复制命令 - 连接心跳故障 [英] Cassandra Copy command-Connection heartbeat failure
问题描述
我在Cqlsh中收到以下错误。复制命令运行几秒钟，然后停止。
I am getting following error in Cqlsh. The copy command runs for a few seconds and then stops.
期待您的帮助。
感谢，
Connected to DRM at 127.0.0.1:9042.
[cqlsh 5.0.1 | Cassandra 2.1.8 | CQL spec 3.2.0 | Native protocol v3]
Use HELP for help.
cqlsh> use myworld;
cqlsh:myworld> copy citizens (id, first_name, last_name, house_no, street, city, country,ssn,phone,bank_name,account_no) from '/home/rashmi/Documents/MyData/Road/PeopleData-18-Jun-1.txt';
Processed 110000 rows; Write: 47913.28 rows/s
Connection heartbeat failure
Aborting import at record #1196. Previously inserted records are still present, and some records after that may be present as well.
我有三个节点设置。 192.168.1.10,11和12. 11是种子。
I have three nodes setup. 192.168.1.10, 11 and 12. 11 being the seed.
CREATE KEYSPACE myworld WITH REPLICATION = { 'class' : 'SimpleStrategy', 'replication_factor' : 1}
create ColumnFamily citizens (id uuid,
first_name varchar,
last_Name varchar,
house_no varchar,
street varchar,
city varchar,
country varchar,
ssn varchar,
phone varchar,
bank_Name varchar,
account_no varchar,
PRIMARY KEY ((Country,city),ssn));
以下Cassandra.yaml
Following from Cassandra.yaml
cluster_name: 'DRM'
(##)initial_token: 0
seeds: "192.168.1.11"
listen_address: 192.168.1.11
endpoint_snitch: GossipingPropertyFileSnitch
推荐答案
，如果它有助于任何人。
Some update to my own question, if it helps anyone.
我的设置基于三台笔记本电脑上的Ubuntu 14的Cassandra 2.2。
My setup is based on Cassandra 2.2 with Ubuntu 14 on three laptops
- I7 MQ 4700 / 16ggs / 1TB驱动器
- I7 MQ 4710/16 gigs / 1TB驱动器
- I7 670/4 Gig / 500GB驱动器（旧机器）
Keyspace，复制系数为3.
使用Max Heap 400 Megs的前两台机器上的8GB Java堆。
Keyspace with replication factor of 3. Java Heap of 8GB on first two machines with Max Heap 400 Megs.
通过我的互联网路由器使用无线网络。
Was using wireless network via my internet router.
汇入70万个含有超过3亿个虚拟金融交易的CSV档案。
Import multiple of 70 Gig CSV files containing 330+ million dummy financial transactions.
心跳失败。
-
使用无线，ping到路由器和其他节点调到200+ ms。使用Cat 5e和Cat 6电缆连接节点。将ping降低到 .3 MS。
With Wireless, ping to router and other node were in tune of 200+ ms. Connected the nodes with Cat 5e and Cat 6 cables. Reduced the ping to < .3 MS.
停止执行其他沉重的磁盘任务，例如同时复制70+个gig文件，并查询大量CQLSH命令，如select，查询磁盘空间和10K数据文件。
Stopped performing additional heavy disk oriented tasks like copying 70+ gig files in the meanwhile, and querying heavy CQLSH commands like select, querying disk space and 10K data files.
数据提取被调整为每秒大约9K行，可能使用大部分磁盘。
Data Ingestion was regulated to about 9K rows per second, probably using most of the disk.
- 第三个节点出现磁盘问题，两者之间也出现了问题。大量提示。
现在
每行导入700,000,000行天，一次使用一台机器。第二个同步导入过程会导致心跳错误。
Present
Import 700+ million rows each day, using one machine at a time. Second simultaneous import process brings up heartbeat error.
没有硬件更改。
谢谢，
这篇关于Cassandra复制命令 - 连接心跳故障的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
