Apache Pig，抑制“输出位置验证失败"“输出目录...已经存在" [英] Apache Pig, Suppress "Output Location Validation Failed" "Output directory ... already exists"

问题描述

在从 orangeoctopus 那里获得关于这个问题的帮助后，我现在需要取消消息输出位置验证失败"输出目录...已经存在".我知道目录存在，我想要那样.我很确定这将是覆盖我的存储 UDF 中的某些内容的问题，但我无法弄清楚是什么.对 Java 完全陌生，所以请耐心等待.提前致谢.

After getting help from orangeoctopus with this question, I now need to suppress the message "Output Location Validation Failed" "Output directory ... already exists". I know the directory exists, I want it that way. I am pretty sure this will be a matter of overriding something in my Storage UDF, but I am having trouble figuring out what. Totally new to Java so bear with me. Thanks in advance.

推荐答案

据我所知，您不能重用直接输出目录.Hadoop 阻止了它.如果我理解正确，您正在处理每日日志，因此，我建议您设置一个父输出目录，称为 output，并将脚本中的输出目录设置为 output/daily_date.

as far as i know, you cannot reuse a direct output directory. Hadoop prevents it. if i understand correctly, you're dealing with daily logs, therefore, i suggest you set a parent output directory say called output, and set your output directory in the script to be output/daily_date.

这篇关于Apache Pig，抑制“输出位置验证失败"“输出目录...已经存在"的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！