java.io.IOException:无效的BCFile [英] java.io.IOException: Not a valid BCFile

问题描述

当我运行纱线日志-applicationId application_1438080928000_6932"时，出现此异常:

when i run "yarn logs -applicationId application_1438080928000_6932", appear this exception:

Exception in thread "main" java.io.IOException: Not a valid BCFile.
    at org.apache.hadoop.io.file.tfile.BCFile$Magic.readAndVerify(BCFile.java:927)
    at org.apache.hadoop.io.file.tfile.BCFile$Reader.<init>(BCFile.java:628)
    at org.apache.hadoop.io.file.tfile.TFile$Reader.<init>(TFile.java:804)
    at org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogReader.<init>(AggregatedLogFormat.java:358)
    at org.apache.hadoop.yarn.logaggregation.LogCLIHelpers.dumpAllContainersLogs(LogCLIHelpers.java:122)
    at org.apache.hadoop.yarn.client.cli.LogsCLI.run(LogsCLI.java:137)
    at org.apache.hadoop.yarn.client.cli.LogsCLI.main(LogsCLI.java:199)

任何人都可以帮忙吗?

推荐答案

在HDP环境中，如果有人在使用某些TFile阅读器手动解析容器日志时遇到此错误，则此答案可能会有所帮助...

In HDP environment if anybody gets this error this while parsing the container logs manually using some TFile reader, this answer might help...

在HDP中， yarn.log-aggregation.file-formats 的默认值为 IndexedFormat，TFile
因此，它将仅以/app-logs/< user>/logs-ifile

In HDP, yarn.log-aggregation.file-formats's default value is IndexedFormat,TFile
So it will aggregate the logs in indexed file format only in /app-logs/<user>/logs-ifile

删除 yarn.log-aggregation.file-formats 属性的IndexedFile值.仅提供 TFile 格式.日志将汇总到/app-logs/< user>/logs

Remove the IndexedFile value for the yarn.log-aggregation.file-formats property. Only give TFile format. The logs will get aggregated in /app-logs/<user>/logs

这篇关于java.io.IOException:无效的BCFile的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！