设计Azure数据工厂管道 [英] Designing Azure Data Factory Pipelines

问题描述

大家好， 

Hi All, 

在Azure数据工厂中构建管道时，我有2个选项 

While building pipeline in Azure Data factory, I have 2 options 

1。使用ADF活动（For-each，Lookup，If等）完成数据加载。

1. Use ADF activity (For-each, Lookup, If etc.) to have my data loading part done.

2。创建自定义批处理活动以执行循环和if / else逻辑并从ADF调用它。 

2. Create a custom batch activity to do looping and if/else logic and call it from ADF. 

只有选项＃2的优点是可以在运行时生成模式，在某些情况下如果有变化，案例将不会显示。 

Only advantage of option #2 is schema can be generated at run time, which in some case will give no visibility if something changes. 

请建议哪一个是最优雅的方式？

Please suggest which one is the most elegant way to do this?

谢谢，Amit  

推荐答案

嗨Amit，

当您使用自定义活动时，您可以使用Azure SDK从操作角度获取几乎所有内容。如果您对自定义活动感到满意，则可以在一个活动中轻松完成您想要的操作。但是，如果您使用其他
活动，则会使其更加模块化并且易于调试。

When you use a custom activity, you can use Azure SDKs to get almost everything done from operations perspective. If you are comfortable with custom activities, you can do what you want very easily within one single activity. However if you use the other activities, it makes it more modular and easy to debug.

因此它们都有它们的优点和缺点，它完全取决于你的用例以及你对.NET（编程）的安慰。

Hence both of them have their pros and cons and it completely depends on your use case and your comfort with .NET (programming).

Hope这有帮助。

这篇关于设计Azure数据工厂管道的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！