MySQL Cluster可以处理TB级数据库吗 [英] Can MySQL Cluster handle a terabyte database

问题描述

我必须研究提供MySQL数据库的解决方案，该数据库可以处理TB级的数据量并且高度可用(五个九).每个数据库行可能都有一个时间戳和最多30个浮点值.预期的工作量为每秒2500次插入.查询可能不那么频繁，但可能很大(可能涉及100Gb数据)，尽管可能只涉及单个表.

I have to look into solutions for providing a MySQL database that can handle data volumes in the terabyte range and be highly available (five nines). Each database row is likely to have a timestamp and up to 30 float values. The expected workload is up to 2500 inserts/sec. Queries are likely to be less frequent but could be large (maybe involving 100Gb of data) though probably only involving single tables.

我一直在研究MySQL Cluster，因为这是他们的HA产品.由于数据量大，我需要使用基于磁盘的存储.实际上，我认为只有时间戳记可以保存在内存中，而所有其他数据都需要存储在磁盘上.

I have been looking at MySQL Cluster given that is their HA offering. Due to the volume of data I would need to make use of disk based storage. Realistically I think only the timestamps could be held in memory and all other data would need to be stored on disk.

有没有人有在如此规模的数据库上使用MySQL Cluster的经验?它甚至可行吗?基于磁盘的存储如何影响性能?

Does anyone have experience of using MySQL Cluster on a database of this scale? Is it even viable? How does disk based storage affect performance?

对于有关如何实现此数据量的所需可用性的建议，我也持开放态度.例如，最好使用像 Sequoia 这样的第三方库来处理标准的MySQL实例?还是基于MySQL复制的更直接的解决方案?

I am also open to other suggestions for how to achieve the desired availability for this volume of data. For example, would it be better to use a third party libary like Sequoia to handle the clustering of standard MySQL instances? Or a more straight forward solution based on MySQL replication?

唯一的条件是它必须是基于MySQL的解决方案.我认为MySQL不是处理我们正在处理的数据的最佳方法，但这是一个硬性要求.

The only condition is that it must be a MySQL based solution. I don't think that MySQL is the best way to go for the data we are dealing with but it is a hard requirement.

推荐答案

可以明智地处理速度.在大小方面，问题不在于数据的大小，而在于索引的大小，因为索引必须完全适合内存.

Speed wise, it can be handled. Size wise, the question is not the size of your data, but rather the size of your index as the indices must fit fully within memory.

我很乐意提供一个更好的答案，但是高端数据库工作非常依赖于任务.我需要对数据的处理情况有更多的了解，才能获得进一步的帮助.

I'd be happy to offer a better answer, but high-end database work is very task-dependent. I'd need to know a lot more about what's going on with the data to be of further help.

这篇关于MySQL Cluster可以处理TB级数据库吗的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！