如何从Azure数据工厂中的azure blob存储中获取某些数据，并将目标作为SQL数据库执行复制活动？ [英] How to get just certain data from azure blob storage in Azure Data Factory performing copy activity with destination as SQL database?

问题描述

我正在尝试在Azure数据工厂中执行复制活动，其中源是Blob（JSON），目标是MySql数据库。

我不希望在该活动期间复制某些数据，并且可以通过读取Blob的JSON的第一个键值元素来确定。

或者如果不可能停止读取所有BLOB数据，那么至少在SQL表中写入时我只需要一些特定的数据（Li ke应该复制一些jsons，并根据blob中存在的键值过滤掉一些jsons。

主要关注的是降低编写无关数据的成本，并在写入后减少存储空间。

解决方案

我想你在这里已经有了一些建议 

https://stackoverflow.com/questions/56259168/copy-blob-data -to-sql-database-in-azure-data-factory-with-conditions / 56265030＃56265030

I am trying to perform Copy Activity inside Azure Data Factory where the source are Blobs (JSON) and destination is MySql database.

I do not want certain data to be copied during that activity and that can be determined by reading First key value Element of the Blob's JSON.

Or maybe if it is not possible to stop reading all the BLOB data then at least while writing inside the SQL table I want just some specific data(Like some jsons should be copied and some filtered out on the basis of a key value present inside blob).

The main focus is to reduce the cost of writing irrelevant data, and to decrease the storage after writing.

解决方案

I think you already have few suggestions here 

https://stackoverflow.com/questions/56259168/copy-blob-data-to-sql-database-in-azure-data-factory-with-conditions/56265030#56265030

这篇关于如何从Azure数据工厂中的azure blob存储中获取某些数据，并将目标作为SQL数据库执行复制活动？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！