如何将大表加载到tableau中以进行数据可视化？ [英] How to load large table into tableau for data visualization?

问题描述

我可以连接tableau与我的数据库，但表的大小在这里真的很大。每次我尝试将表加载到表格，它是崩溃，我不能找到任何工作。表格大小从1000万到4亿行不等。我应该如何处理这个问题的任何建议？

I am able to connect tableau with my database but the table size is really large here. Everytime I try to load the table into tableau, it is crashing and I am not able to find any work around. The table size varies from 10 million - 400 million rows. How should I approach this issue any suggestion ?

推荐答案

我发现了一个简单的解决方案，用于优化Tableau来处理非常大的数据集（10亿行）：Google BigQuery

I found a simple solution for optimising Tableau to work with very large datasets (1 billion+ rows): Google BigQuery, which is essentially a managed data warehouse.

1. 将数据上传到 BigQuery （您可以将多个文件附加到单个表格中）。


2. 将表格链接到Tableau作为外部数据源

1. Upload data to BigQuery (you can append multiple files into a single table).
2. Link that table to Tableau as an external data source

每当请求一个新的视图时，Tableau就会向BigQuery发送类似SQL的命令。查询在Google的计算硬件上快速处理，然后将一小部分信息发送回Tableau。

Tableau then sends SQL-like commands to BigQuery whenever a new 'view' is requested. The queries are processed quickly on Google's computing hardware, which then sends a small amount of information back to Tableau.

这种方法使我可以看到一个100gb的移动通话记录数据集， MacBook上有10亿行。

This method allowed me visualise a 100gb mobile call record dataset with ~1 billion rows on a MacBook.

这篇关于如何将大表加载到tableau中以进行数据可视化？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！