打包时将错误行重定向到flatfile [英] Packing is hanging while redirecting error rows to flatfile

问题描述

1。将数据从查询加载到sql表并将行重定向到平面文件

2.结构是oledbsource - > oledbdestination1 with fastload - > oledb destination2 with maxinsertcommitsize to 1（以避免所有批处理行进入错误平面文件目的地） - > flatfiledestination加载错误行



现在的问题是我得到230个错误行，包正在递送到第二个oledb目的地并取一个有点时间完成。表现不佳。

1. loading data from query to sql table and redirecting rows to flat file
2. structure is oledbsource-->oledbdestination1 with fastload-->oledb destination2 with maxinsertcommitsize to 1(to avoid all batch rows go to error flatfile destination)-->flatfiledestination to load error rows

Now the issue is I getting 230 error rows and package is handing at 2nd oledb destination and taking a bit time to complete. performance is not good.

如何解决这个问题

推荐答案

您好Tangirala，

Hi Tangirala,

我建议选择pre-valiadtion阶段来隔离坏行，然后先将文件放到文件中。

I recommend opting for pre-valiadtion stage to isolate the bad rows and put then to the file first.

To为此，您需要将数据加载到临时表中，然后应用任何必要的验证，最后只处理那些在验证后幸存的行。

To do that you would need to load the data into a staging table 1st then apply whatever validation necessary, finally process only those rows that survived the validation.

这篇关于打包时将错误行重定向到flatfile的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！