java.io.IOException:无效的BCFile [英] java.io.IOException: Not a valid BCFile
问题描述
当我运行纱线日志-applicationId application_1438080928000_6932"时,出现此异常:
when i run "yarn logs -applicationId application_1438080928000_6932", appear this exception:
Exception in thread "main" java.io.IOException: Not a valid BCFile.
at org.apache.hadoop.io.file.tfile.BCFile$Magic.readAndVerify(BCFile.java:927)
at org.apache.hadoop.io.file.tfile.BCFile$Reader.<init>(BCFile.java:628)
at org.apache.hadoop.io.file.tfile.TFile$Reader.<init>(TFile.java:804)
at org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogReader.<init>(AggregatedLogFormat.java:358)
at org.apache.hadoop.yarn.logaggregation.LogCLIHelpers.dumpAllContainersLogs(LogCLIHelpers.java:122)
at org.apache.hadoop.yarn.client.cli.LogsCLI.run(LogsCLI.java:137)
at org.apache.hadoop.yarn.client.cli.LogsCLI.main(LogsCLI.java:199)
任何人都可以帮忙吗?
推荐答案
在HDP环境中,如果有人在使用某些TFile阅读器手动解析容器日志时遇到此错误,则此答案可能会有所帮助...
In HDP environment if anybody gets this error this while parsing the container logs manually using some TFile reader, this answer might help...
在HDP中, yarn.log-aggregation.file-formats
的默认值为 IndexedFormat,TFile
因此,它将仅以/app-logs/< user>/logs-ifile
In HDP, yarn.log-aggregation.file-formats
's default value is IndexedFormat,TFile
So it will aggregate the logs in indexed file format only in /app-logs/<user>/logs-ifile
删除 yarn.log-aggregation.file-formats
属性的IndexedFile值.仅提供 TFile
格式.日志将汇总到/app-logs/< user>/logs
Remove the IndexedFile value for the yarn.log-aggregation.file-formats
property. Only give TFile
format.
The logs will get aggregated in /app-logs/<user>/logs
这篇关于java.io.IOException:无效的BCFile的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!