Bigtable数据库设计理论 [英] Bigtable database design theory

问题描述

我很精通关系数据库设计的理论和实践。

我知道什么是有效的，什么不行，什么是性能和什么是可维护的（几乎 - 在开始获取真实数据的时候总是有调整的地方）。

似乎我找不到关于分布式可扩展数据库的大量知识，例如Google的Bigtable（用于为Google应用引擎编写应用）。有什么工作，什么不会，什么将扩大，为什么不会？

当然有一些博客文章和文章，但有书籍或学术研究论文设计大型桌面和类似数据库范式的数据库？

解决方案

...有书籍或学术研究
论文设计数据库
bigtable和类似数据库
范例？

好Bigtable是本质上是一个数据库本身，所以我认为你的问题更多的是如何建模，并在一定程度上在这些Bigtable像数据库中设计你的架构。更具体地说，您想知道如何在Google的App Engine上执行此操作。

使用GAE，您将使用Datastore API，它为Bigtable添加了一个重要的抽象层，所以在某种程度上你不必担心低级别的细节，就像你使用像HBase这样的东西一样。 SO上有几个帖子（这里是一个很棒的答案我认为是GAE团队的一部分的Google工程师的很好的答案），将引导您并提供如何处理这种新型数据库系统的提示。

有用的信息：

1. HBase 的灵感来自于Google的 Bigtable （替代链接）纸张


2. Hypertable 也受到Bigtable纸张的启发。


3. 的灵感来源于Bigtable纸张


4. Hadoop 受到Google的和 MapReduce 论文

I am very well versed in the theory and practice of relational database design.

I know what works and what doesn't, what is performant and what is maintainable (almost - there's always place to tweak when you start having real data).

It seems I can't find a substantial body of knowledge regarding distributed scalable databases such as Google's Bigtable (for writing apps for google app engine). What works, what doesn't, what will scale, why won't?

Sure, there are some blog posts and articles, but are there books or academic research papers on designing databases for bigtable and similar database paradigms?

解决方案

... are there books or academic research papers on designing databases for bigtable and similar database paradigms?

Well Bigtable is essentially a database itself, so I take it that your question is more on how to model and to some extent design your schema in these Bigtable like databases. More specifically you would like to know how to do this on Google's App Engine.

With GAE you will be using the Datastore API, which adds a significant layer of abstraction to Bigtable, so to some extent you don't have to worry about low level details as you would if you were using something like HBase. There are a few posts on SO (here's a great answer by a Google Engineer who I think is part of GAE team) that will guide you and offer hints on how to approach this new type of Database system.

Helpful Info:

1. HBase was inspired by Google's Bigtable (Alternate Link) paper
2. Hypertable was also inspired by Bigtable paper
3. Cassandra's Data Model was inspired by Bigtable paper
4. Hadoop was inspired by Google's GFS and MapReduce papers

这篇关于Bigtable数据库设计理论的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！