哪个数据库可以很好地处理200 + GB的数据? [英] What database works well with 200+GB of data?

问题描述

我一直在使用mysql(与innodb一起使用；在Amazon rds上)，因为它是通用的默认设置，但是表现却很可笑，调整它只会延迟不可避免的事情.

I've been using mysql (with innodb; on Amazon rds) because it's sort of universal default, but it's been ridiculously under-performing, and tweaking it only delays the inevitable.

数据大多相对较短(每个字节<1kB)，模糊了有关100M网址的信息.有(或者应该是，mysql似乎无法处理它)大量的插入/更新/检索，但是很少有复杂的查询-并不是说复杂的查询不会有用，而是因为mysql太慢了，所以获取起来要快得多数据出来，在本地处理，并将结果缓存在某个地方.

The data is mostly relatively short (<1kB of bytes each) blobs information about 100Ms of urls. There is (or should be, mysql cannot seem to handle it) very high amount of insert / update / retrieve but few complex queries - not that complex queries wouldn't be useful, but because mysql is so slow that it's far faster to get the data out, process it locally, and cache the results somewhere.

我可以继续调整mysql并为其添加更多硬件，但似乎越来越徒劳.

I can keep tweaking mysql and throwing more hardware at it, but it seems increasingly futile.

那有什么选择呢? SQL/关系模型/等可选-只要快速，联网且独立于语言，一切都会做.

So what are the options? SQL/relational model/etc. optional - anything will do as long as it's fast, networked, and language-independent.

推荐答案

我不确定我是否同意在传统数据库上跳转的建议.它可能不是最有效的工具，但它是FAR被更广泛地理解和使用的工具，并且强烈怀疑您遇到的问题无法通过有效地建立关系数据库来解决. 显而易见的答案是Oracle，SQLServer等，但这可能只是您的数据库结构不正确.我对MySQL不太了解，但我确实知道它已在一些相当大的项目中使用(eBay值得关注).

I'm not sure I agree with the advice to jump ship on traditional databases. It might not be the most efficient tool, but it is the one that is FAR more widely understood and used, and a strongly doubt you have a problem that can't be handled by an efficiently set up relational database. Obvious answers are Oracle, SQLServer, etc, but it might just be your database structure isn't right. I don't know much about MySQL but I do know it's used in some pretty big projects (eBay being noteworthy).

这篇关于哪个数据库可以很好地处理200 + GB的数据?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！