如何在一个表中插入来自数千个源的数据 [英] How to insert data from thousands of sources in one table

问题描述

Hello Everyone



我有一个要求，我必须通过网络从近10000个来源获取信息，并在飞行时间将其存储在一个表中。您可以说这些资源就像数百万具有唯一ID的设备，我需要将数据泵入PostgreSQL中的单个表格。



什么是最好的方法这样它不会降低数据库的性能，也不会获得任何锁定以及影响其他事务。

Hello Everyone

I have a requirement where I have to get info from almost 10000 sources over net and store it in a single table in fly time. These resources u can say are like millions of devices having unique id and I need to pump data into a single table in PostgreSQL.

What can be best possible approach to do this so that it doesn't degrades the performance of database and also doesn't acquire any lock as well to impact other transaction as well.

推荐答案

性能取决于许多因素，但在您的情况下，您应该首先指定输入率以及如何查询数据。



根据这两个因素，您的索引策略或使用情况一般情况下，关系数据库会发生变化。



在任何情况下，如果您提供的信息有限，唯一有效的答案就是试试看。

Performance depends on many factors, but in your case you should specify the input rate and how you are going to query the data first.

Depending on those two factors your indexing strategy or the use of relational databases in general, will change.

In any case with the limited information you have provided, the only valid answer is try and see.

这篇关于如何在一个表中插入来自数千个源的数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！