Lucene词干分子之间的区别：EnglishStemmer，PorterStemmer，LovinsStemmer [英] Difference between Lucene stemmers: EnglishStemmer, PorterStemmer, LovinsStemmer

问题描述

有人比较了Lucene的这些词干分析器（包org.tartarus.snowball.ext）：
EnglishStemmer，PorterStemmer，LovinsStemmer？
算法的优点/缺点是什么？
什么时候应该使用它们？
或许还有一些算法可用于英语单词词干？

Have anybody compared these stemmers from Lucene (package org.tartarus.snowball.ext): EnglishStemmer, PorterStemmer, LovinsStemmer? What are the strong/weak points of algorithms behind them? When each of them should be used? Or maybe there are some more algorithms available for english words stemming?

谢谢。

推荐答案

Lovins词干分析器是很老的算法由于Porter主干更强大，因此实用性不大。基于一些快速浏览源代码，似乎 PorterStemmer 实现了Porter的 original（1980）算法，而 EnglishStemmer 实现了他的更新版本，应该会更好。

The Lovins stemmer is a very old algorithm that is not of much practical use, since the Porter stemmer is much stronger. Based on some quick skimming of the source code, it seems PorterStemmer implements Porter's original (1980) algorithm, while EnglishStemmer implements his updated version, which should be better.

更强的词干算法（实际上是一个词形变换器）是可在斯坦福NLP工具中找到。您可以通过这里获得Lucene-Stanford NLP（ API docs ）。

A stronger stemming algorithm (actually a lemmatizer) is available in the Stanford NLP tools. A Lucene-Stanford NLP by yours truly bridge is available here (API docs).

参见 Manning，Raghavan& Schütze有关词干和词形还原的一般信息。

See also Manning, Raghavan & Schütze for general info about stemming and lemmatization.

这篇关于Lucene词干分子之间的区别：EnglishStemmer，PorterStemmer，LovinsStemmer的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！