如何在文本中搜索一个人的名字? (启发式) [英] How to search for a person's name in a text? (heuristic)
问题描述
我有一个人的全名的巨大列表，我必须在巨大文本中进行搜索.
I have a huge list of person's full names that I must search in a huge text.
仅名称的一部分可能会出现在文本中.并且可能是拼写错误，未键入错误类型或缩写.文本没有标记，因此我不知道人名在文本中的开头.而且我不知道文本中是否会出现名称 .
Only part of the name may appear in the text. And it is possible to be misspelled, misstyped or abreviated. The text has no tokens, so I don't know where a person name starts in the text. And I don't if know if the name will appear or not in the text.
示例:
我的列表中有巴拉克·侯赛因·奥巴马" ，因此我必须在以下文本中检查该名称的出现情况:
I have "Barack Hussein Obama" in my list, so I have to check for occurrences of that name in the following texts:
- ...候选人的奥巴马当选美国总统......(不完整)
- ...候选人的巴拉克·侯赛因·当选美国总统......(不完整)
- ...候选人的奥巴马H. O操作.当选美国总统......(略)
- ...候选人的奥巴马ObaNa 当选美国总统......(拼写错误)
- ...候选人的奥巴马OVama 当选美国总统......(misstyped，B毗邻V)
- ...候选人 John McCain 失去了选举...(没有出现奥巴马的名字)
- ...The candidate Barack Obama was elected the president of the United States... (incomplete)
- ...The candidate Barack Hussein was elected the president of the United States... (incomplete)
- ...The candidate Barack H. O. was elected the president of the United States... (abbreviated)
- ...The candidate Barack ObaNa was elected the president of the United States... (misspelled)
- ...The candidate Barack OVama was elected the president of the United States... (misstyped, B is next to V)
- ...The candidate John McCain lost the the election... (no occurrences of Obama name)
从本质上讲，没有确定性的解决方案，但是...
Certanily there isn't a deterministic solution for it, but...
对于这种搜索，什么是一种很好的启发式方法?
What is a good heuristic for this kind of search?
如果必须的话，你会怎么做?
If you had to, how would you do it?
推荐答案
您说的内容约为200页.
You said it's about 200 pages.
将其分为200张一页的PDF.
Divide it into 200 one-page PDFs.
将每页以及名称列表放在Mechanical Turk上.提供每页约5美元的奖励.
Put each page on Mechanical Turk, along with the list of names. Offer a reward of about $5 per page.
这篇关于如何在文本中搜索一个人的名字? (启发式)的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
