需要分页时使用HTTP API Rest Call复制管道设置吗? [Facebook] [英] Copy pipeline setup with HTTP API Rest Calls when pagination is required? [Facebook]

问题描述

我们正在尝试将HTTP API管道副本与Facebook的Graph API结合使用，以提取一些我们希望对其进行分析的数据.提取小型顶级JSON条目时，系统运行良好，但是当您请求更大的数据集时 图API将对结果进行分页，我无法弄清楚如何使用复制管道设置进行处理.这对于数据工厂来说是非常普遍的用法，所以我只是在寻找一些有关如何正确配置此配置的指南.

We are trying to leverage the HTTP API pipeline copy with Facebook's Graph API to ingest some data that we'd like to run analytics on. When ingesting small, top level JSON entries the system works quite well but when you request a bit larger set of data the graph API will paginate the result which I can't figure out how to handle with the copy pipeline setup. This has to be a pretty common use for the data factory so I'm just looking for some guidance on how I would go about getting this configured correctly. 

谢谢

Casey

推荐答案

嗨凯西，

当前，ADF HTTP连接器不支持分页，而仅支持从单个URL检索数据.抱歉，使用复制活动在您的方案上没有好的解决方案.在ADF中，替代方法可能是使用.NET自定义活动来实现 这样复制自己.

Currently ADF HTTP connector don't support pagination but only support retrieving data from a single URL. Sorry that there is no good solution on your scenario using copy activity. Within ADF, alternative may be to use .NET custom activity to implement such copy yourself.

谢谢

Linda

这篇关于需要分页时使用HTTP API Rest Call复制管道设置吗? [Facebook]的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！