从Dynamics CRM到Data Lake获取增量数据 [英] Get Incremental Data From Dynamics CRM to Data Lake

问题描述

我们正在将数据从CRM迁移到Data Lake，这很好，但是我们不确定如何获取增量数据.

We are moving data from CRM to Data Lake which is working fine, however we are not sure how to get incremental data.

由于数据存储在数据湖中，因此我无法找到一种将lasttimestamp存储到ADF在下一次执行时可以读取的位置的方法.

As data is stored in data lake I'm not able to find a way of storing lasttimestamp into somewhere from where ADF can read on next execution.

ADF无法从数据湖目录中读取数据，而Data Lake U-SQL无法写入SQL Azure，因此我不确定如何从可用于下一次执行的数据中捕获时间戳.

ADF cannot read from data lake catalog and Data Lake U-SQL cannot write to SQL Azure so I'm not sure how can we capture timestamp from data which can be used on next execution.

有什么建议吗?

谢谢

Dilkush

感谢Dilkush Patel Microsoft SQL开发人员支持Microsoft Corporation

Thanks, Dilkush Patel Microsoft SQL Developer Support Microsoft Corporation

推荐答案

Hello Dilkush，

Hello Dilkush,

获取元数据"活动可以从ADL中读取创建"和最后修改":

The Get metadata activity can read 'created' and 'last modified' from ADL:

https://docs.microsoft.com/en -us/azure/data-factory/control-flow-get-metadata-activity

您可以使用其中一个值来进行增量加载吗?

Could you use either one of those values to make incremental loading work?

这篇关于从Dynamics CRM到Data Lake获取增量数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！