U-SQL中String的最大允许大小是多少? [英] What is the maximum allowed size for String in U-SQL?
问题描述
在处理CSV文件时,出现有关最大字符串大小的错误. 字符串大小超出了允许的最大大小."
while processing a CSV file, I am getting an error about maximum string size. "String size exceeds the maximum allowed size".
推荐答案
当前,U-SQL中字符串的最大允许大小为 128 KB .
Currently the maximum allowed size for a string in U-SQL is 128 KB.
如果您现在需要处理更大的大小,那么从CSV文件读取时,请使用byte []类型代替.稍后,随着行集在某些C#代码正文中的脚本中处理,您可以将byte []转换为字符串,然后执行C#代码中所需的任何字符串操作.
If you need to handle larger sizes than that for now, then use the byte[] type instead when reading from the CSV file. Later, as the rowsets are processed in the script in the body of some C# code you can transform the byte[] into a string and do whatever string operations you need in the C# code.
注意: U-SQL中的行也具有最大大小(当前为4MB).并且该技术也受到该限制.
NOTE: Rows in U-SQL also have a maximum size (Currently 4MB). And this technique is also subject to that limitation.
如果您对支持大于128 KB的字符串大小的方案感兴趣,请在此处对功能请求进行投票,将您的方案添加为注释也将非常有帮助..
If you are interested in scenarios that support a string size that is greater than 128 KB, please vote on the feature request here, adding your scenario as comments would be super helpful as well.. https://feedback.azure.com/forums/327234-data-lake/suggestions/13416093-usql-string-data-type-has-a-size-limit-of-128kb
这篇关于U-SQL中String的最大允许大小是多少?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!