在加载到SSIS包中的（SQL）DB表之前从文件中删除dupes [英] Removing the dupes from file(s) before loading into (SQL) DB table in SSIS package

问题描述

我有2个文件（文本），我想加载到我的DB（SQL）表中。但我的两个文件中都有 dupes （主键欺骗）如何在将文件加载到SSIS包中的数据库之前根除或消除文件中的欺骗行为。



有人可以详细告诉我所有的任务是什么（控制流任务和数据流任务）我必须包含在SSIS包中才能完成上述任务？

I have 2 files (text) that I want to load into my DB (SQL) table.But my both the files have dupes in them (primary key dupes and duplicate rows).So how to eradicate or eliminate dupes from files before loading it to DB in SSIS packages.

Can some one tell me in detail what all the tasks (Controlflow task and Data flow task) I have to include in a SSIS package to achieve the above task?

推荐答案

我最近必须在SSIS包中做到这一点。我使用了排序转换并选中了删除具有重复排序值的行框。



这是一篇非常好的文章，介绍了如何做到这一点。

http://www.mssqltips.com/ sqlservertip / 3036 / removed-duplicates-rows-with-ssis-sort-transformation / [ ^ ]

I had to do that recently inside an SSIS package. I used the sort transformation and checked the box to "remove rows with duplicate sort values".

This is a pretty good article on how to do that.
http://www.mssqltips.com/sqlservertip/3036/removing-duplicates-rows-with-ssis-sort-transformation/[^]

这篇关于在加载到SSIS包中的（SQL）DB表之前从文件中删除dupes的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！