如何在Azure数据工厂管道中添加验证以检查文件大小? [英] How to add a validation in azure data factory pipeline to check file size?

问题描述

我有多个数据源，我想在加载到表中之前在azure数据工厂中添加一个验证，它应该检查文件大小，以便它不为空.因此，如果文件大小超过10 kb，或者文件大小不为空，则应开始加载；如果文件为空，则应不开始加载.我在Azure数据工厂中检查了验证活动，但未显示文件夹中多个文件的大小.如果我可以添加任何python笔记本进行此验证，基本上任何赞赏的建议也都可以.

I have multiple data sources I want to add a validation in azure data factory before loading into tables it should check for file size so that it is not empty. So if the file size is more than 10 kb or if it is not empty loading should start and if it is empty then loading should not start. I checked validation activity in Azure Data Factory but it is not showing size for multiple files in a folder. Any suggestions appreciated basically if I can add any python notebook for this validation will also do.

推荐答案

下面的GIF显示了有关如何在ADF中实现上述要求的分步过程.

Following GIF shows step by step process on how to achieve the above requirement in ADF.

这篇关于如何在Azure数据工厂管道中添加验证以检查文件大小?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！