我可以在bigquery中对多个大表进行非规范化吗 [英] can I denormalize multiple large tables in bigquery

问题描述

我可以在bigquery中对多个大表进行非规范化(通过联接)吗?

Can I denormalize (by joining) multiple large tables in bigquery?

表1中有4亿行 Table2是2M行 Table3是80万行

Table1 is 400M rows Table2 is 2M rows Table3 is 800K rows

如果没有，上传之前是否必须在关系数据库中进行?那将是一个困难的解决方案.

If not, do I have to do it in my relational database before I upload? That would be a difficult solution.

我应该将表分成较小的块并在表上运行联接的迭代，以使它始终从小到大吗?这也是一个困难的解决方案.

Should I chunk the tables into smaller pieces and run iterations of joins over the tables so that it is always large to small? This would also be a difficult solution.

谢谢.

推荐答案

BigQuery现在支持大联接"，使您可以在联接查询中跳过LIMIT.

BigQuery now supports "Big JOINs" which allows you skip the LIMIT's in your JOIN queries.

文档在这里: https://developers.google.com/bigquery/docs/query-reference#joins

这篇关于我可以在bigquery中对多个大表进行非规范化吗的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！