使用 SSIS 插入记录而不插入预先存在的记录 [英] Using SSIS to insert records without inserting preexisting records

问题描述

我有一个 2.9 亿的源数据集，我每天下载 1200 万条记录，其中包含前几天下载的数据.我在将每日记录插入源并排除我已有的记录时遇到问题.一些新记录可能不是前一天的记录，它们可能是几天前的记录，因此日期限制不起作用.请帮忙.

I have a 290 million source data set and I get a daily download of 12 million records daily which contain data from the previous days downloads. I am having trouble inserting the daily records into the source and excluding the records I already have. Some of the records that are new may not be from the previous day they could be several days back so a date restriction wont work. Please help.

推荐答案

我刚刚在 SSIS 的数据流中遇到了完全相同的问题，您需要添加查找.让它根据PK将您插入的数据与新数据相匹配.然后你可以从这里分离数据，选择重定向行到不匹配的输出.这将使绿色箭头包含所有不存在的数据.

I just had this exact same issue basically in your Data flow of your SSIS you need to add a Lookup. Have it match the data your inserting to the new data based on the PK. then you can separate the data from here, choose Redirect Rows to no match output. This will make the green arrow contain all data that is no present.

这篇关于使用 SSIS 插入记录而不插入预先存在的记录的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！