跳过Map中.csv的第一行以减少Java [英] Skipping the first line of the .csv in Map reduce java
本文介绍了跳过Map中.csv的第一行以减少Java的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
由于mapper函数在每一行上运行,我可以知道如何跳过第一行.对于某些文件,它包含我要忽略的列标题
As mapper function runs for every line , can i know the way how to skip the first line. For some file it consists of column header which i want to ignore
推荐答案
在映射器中,在读取文件时,数据将作为键值对读取.关键是下一行开始处的字节偏移量.对于第1行,它始终为零.因此,在mapper函数中执行以下操作
In mapper while reading the file, the data is read in as key-value pair. The key is the byte offset where the next line starts. For line 1 it is always zero. So in mapper function do the following
@Override
public void map(LongWritable key, Text value, Context context) throws IOException {
try {
if (key.get() == 0 && value.toString().contains("header") /*Some condition satisfying it is header*/)
return;
else {
// For rest of data it goes here
}
} catch (Exception e) {
e.printStackTrace();
}
}
这篇关于跳过Map中.csv的第一行以减少Java的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文