如何比较在NLP中描述相同概念的一组短语的有意义水平? [英] How to compare meaningful level of a set of phrase that describe same concept in NLP?
问题描述
我有两个名词车辆"和机动车辆".有什么方法可以在NLP中比较这两者的有意义程度或歧义程度?结果应该是机动车"比车辆"更有意义,或者机动车"比机动车"更模糊.谢谢
I have two terms "vehicle" and "motor vehicle". Are there any way to compare the meaningfulness level or ambiguity level of these two in NLP? The outcome should be that "motor vehicle" is more meaningful than "vehicle" or "vehicle" is more ambiguous than "motor vehicle". Thanks
推荐答案
The question you ask is very broad (see here) but here are some hints for starting points:
- WordNet
- Word embeddings: word2vec, Glove
您正在寻找的含义差异非常特殊,因此我建议从WordNet开始(也有其他语言的WordNet). 使用WordNet来计算的代码意味着使用WordNet的差异,您可以找到
The meaning difference you are looking into is quite peculiar so I suggest starting with WordNet (there are WordNets for other languages as well). The code that uses WordNet to calculate meaning differences using WordNet you can find here.
NLTK 是开始NLP旅程的良好框架.
Good framework to start an NLP journey is NLTK.
这篇关于如何比较在NLP中描述相同概念的一组短语的有意义水平?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!