ADF表存储分页 [英] ADF Table Storage Pagination
问题描述
我想为Azure表中的每一行调用Azure函数。
I want to call a Azure Function for each row in a Azure Table.
Azure表有50000行。
The Azure Table has 50000 Rows.
Lookup活动最多有5,000行，最大大小为2 MB。
The Lookup activity has a maximum of 5,000 rows, and a maximum size of 2 MB.
如何处理所有50000行？我可以在循环中进行分页（例如像延续令牌）吗？
How can I handle all 50000 Rows? Can I do a Pagination in a loop (e.g. like a continuation token) ?
切换到Azure SQL数据库并使用类似"从x中选择顶部（1000）"更好吗？ ;
Is it better to switch to a Azure SQL Database and use something like "select top(1000) from x"?
谢谢，
Stefan
Found similar problem here: https://social.msdn.microsoft.com/Forums/en-US/99477738-c412-4104-84b6-1ab529c19f1a/data-factory-lookup-size-limitation?forum=AzureDataFactory
推荐答案
嗨Stefan，
Hi Stefan,
对Table服务的查询一次最多可返回1,000个项目，并且最多可执行五秒。如果结果集包含超过1,000个项目，如果查询未在五秒内完成，或者查询超过
分区边界，则响应包括为开发人员提供继续令牌以便恢复的头文件结果集中下一项的查询。
A query against the Table service may return a maximum of 1,000 items at one time and may execute for a maximum of five seconds. If the result set contains more than 1,000 items, if the query did not complete within five seconds, or if the query crosses the partition boundary, the response includes headers which provide the developer with continuation tokens to use in order to resume the query at the next item in the result set.
如果有更多条目，API将返回客户端需要在后续请求中发送的延续令牌。
If there are more entries, the API returns a continuation token which the client needs to send in a subsequent request.
每次调用返回的路径数都是有限的。如果要返回的路径数超过此限制，则在响应头x-ms-continuation中返回延续令牌。当在响应中返回延续令牌时，必须在后续调用列表操作中指定
以继续列出路径。
The number of paths returned with each invocation is limited. If the number of paths to be returned exceeds this limit, a continuation token is returned in the response header x-ms-continuation. When a continuation token is returned in the response, it must be specified in a subsequent invocation of the list operation to continue listing the paths.
有关更多详细信息，请参阅"< a href ="https://docs.microsoft.com/en-us/rest/api/storageservices/query-timeout-and-pagination">查询超时和分页"。
For more details, refer "Query Timeout and Pagination".
您可以参考
SO 解决类似问题的主题。
You may refer SO thread which addressing similar issue.
希望这会有所帮助。
这篇关于ADF表存储分页的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
