我可以在BigQuery的准备工作中对Google Cloud SQL中的数据进行非规范化吗 [英] Can I denormalize data in google cloud sql in prep for bigquery

问题描述

鉴于bigquery并不旨在作为非规范化数据的平台，我可以在导入bigquery之前在Google Cloud sql中对数据进行规范化吗?

Given that bigquery is not meant as a platform to denormalize data, can I denormalize the data in google cloud sql prior to importing into bigquery?

我有下表:Table1 500M行，Table2 2M行，Table3 800K行，

I have the following tables: Table1 500M rows, Table2 2M rows, Table3 800K rows,

由于各种原因，我无法在我们现有的关系数据库中进行非规范化.因此，我想对数据库进行sql转储，将其加载到google cloud sql中，然后使用sql join脚本创建一个要导入到bigquery中的大平面表.

I can't denormalize in our existing relational database for various reasons. So I'd like to do a sql dump of the data base, load it into google cloud sql, then use sql join scripts to create one large flat table to be imported into bigquery.

谢谢.

推荐答案

应该可以.您应该能够将生成的平面表转储到csv并导入到bigquery.但是，目前没有直接的Cloud SQL到bigquery加载机制.

That should work. You should be able to dump the generated flat table to csv and import to bigquery. There is no direct Cloud SQL to bigquery loading mechanism, currently, however.

这篇关于我可以在BigQuery的准备工作中对Google Cloud SQL中的数据进行非规范化吗的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！