控制Hive中的冗长级别 [英] controlling the level of verbosity in Hive

问题描述

我以命令行的方式运行配置单元：

  hive -eselect * from table; 
  

它给我提供了查询的所有细节和阶段。
如果我这样做：

  hive -S -eselect * from table; 
  

它没有提供任何细节。

我想要显示map reduce的每个步骤的mappers和reducers的数量，以及map reduce步骤的数量，但我不想看到所有的信息：

  2013-01-02 12：46：28,756第一阶段地图= 100％，减少= 67％，累计CPU 287.99秒
  

那么，是否有可能更详细地控制Hive的详细程度？谢谢！

解决方案

我的解决方案以

  hive。 2& 1 | grep --line-buffered -v -e'map =。*，reduce ='| tee log 
  

这很糟糕（可能会杀死更多的人），但这是最好的能够拿出到目前为止。

编辑：请观看并投票日志记录（进度报告）过于冗长

I run hive from command line that way:

hive -e "select * from table;"

and it gives me all the details and stage of my query. If I do:

hive -S -e "select * from table;"

It doesn't give any detail.

What I would like to have is just to be shown the numbers of mappers and reducers for each step of map reduce, as well as the number of map reduce steps, but I don't want to see all the informations like:

2013-01-02 12:46:28,756 Stage-1 map = 100%,  reduce = 67%, Cumulative CPU 287.99 sec

So, is it possible to have a more granular control of the verbosity with Hive? Thanks!

解决方案

My "solution" to the same problem is

hive ... 2>&1 | grep --line-buffered -v -e ' map = .*,  reduce = ' | tee log

This sucks (and might kill more than necessary), but this is the best I have been able to come up with so far.

EDIT: please watch and vote for The logging (progress reporting) is too verbose

这篇关于控制Hive中的冗长级别的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！