将Millon记录发送到另一个存储库 [英] Send a millon record to another repository

问题描述

将一百万条记录发送到另一个存储库文件的最佳方法是什么?

我有一个提供这些记录的网络服务，接收者发送一个ACK确认接收正常，这种方式非常慢.

Greetings

解决方案

一种方法是一次性发送多条记录.
这样，客户端无需确认每个记录.
为了确保已接收到所有记录，您可以先发送一些字节数或记录数，然后在接收到记录后可以对它们进行交叉检查，或者可以采用更强大的方法来使用CRC检查.

如果无法实现_Superman_的解决方案，则可以打开多个连接.

这样一来，您就不会被阻止.

你好ollanthay426，

如果您知道SSIS(SQL Server集成服务)，则可以执行此操作. SSIS设计为执行ETL操作(提取，传输，加载).同样，在这种情况下，您可以连接多个源并将这些数据转储到一个中央数据仓库中.

What is the best way to send a million records to another repository p.e to file?

I have a webservice that provide these records one by one, and receptor send a ACK that confirm the reception is ok, this way is very slow.

Greetings

解决方案

One way is to send multiple records in one shot.
This way the client does not need to ACK each record.
To ensure all records have been received, you could send some byte count or record count first that can be cross-checked after the records have been received or you could go for a more robust way of using something like a CRC check.

If you can''t implement _Superman_''s solution, you could open multiple connections.

Then you''re not blocked on one single request.

Hello ollanthay426 ,

If you know SSIS (Sql Server Integration Services) then you can do this thing. SSIS is designed to perform ETL operation (Extract , Transfer , Load) . Also here in your case you can connect multiple sources and dump that data into one central Data warehouse.

这篇关于将Millon记录发送到另一个存储库的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！