mongoDB 32位2GB限制，最佳做法 [英] mongoDB 32-bit 2GB limit, best practices

问题描述

在Windows XP上运行32位Mongo 2.0.1的Mongo新手.目前没有运行64位的选项.

Mongo newbie running 32-bit Mongo 2.0.1 on Windows XP. No option at present to run 64-bit.

我想使用Mongo映射减少60个文件的集合，每个文件是相同的20,000行x 100列表的每月快照.理想情况下，我将它们全部放在一个集合中-尽管这涉及约1.2GB的CSV数据，但它远远超过2GB的mongoimport数据.

I want to use Mongo to map-reduce a set of 60 files, each a monthly snapshot of the same 20,000 row x 100 column table. Ideally I'd put them all in one collection - and although this comes to about 1.2GB of csv data, it's well over 2GB of mongoimport'ed data.

问题:我是否应该围绕此编程(缩小60幅图)，或者是否有一个Mongo新手可以解决的不太繁琐的工程解决方案(使用分片或某些技巧，由于基础数据而导致的肿存储减少了)实际上是带有定义列的简单表格.)

Question: should I program around this (60 map reduces) or is there a not-too-cumbersome engineering solution that a Mongo newbie could tackle (either w sharding or some trick that results in less bloated storage given that the underlying data is really a simple table w defined columns).

推荐答案

您可以通过分片来超过2Gb的限制. 2Gb限制适用于单个mongod进程，而不适用于分片数据集中的全部数据.

You can go over the 2Gb limit by sharding. The 2Gb limit applies to individual mongod processes, rather than the total data in the sharded dataset.

此处是有关分片入门的一些文档.还有用于在其上设置分片环境的Python脚本一台机器.我认为它将在Windows上运行.

Here is some documentation about getting started with sharding. There is also a Python script for setting up a sharded environment on a single machine. I assume it will work on Windows.

这篇关于mongoDB 32位2GB限制，最佳做法的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！