Solr 在使用存储的 html 字段突出显示时剥离 html [英] Solr Strip html when highlighting with stored html fields

问题描述

在 Rails 中使用 Solr 和 Sunspot.

Using Solr and Sunspot in rails.

我正在使用如下字段类型搜索 html 字段:

I am searching on an html field using a field type like this:

<fieldType name="text_html" class="solr.TextField" omitNorms="false">
  <analyzer>
    <tokenizer class="solr.StandardTokenizerFactory"/>
    <charFilter class="solr.HTMLStripCharFilterFactory"/>
    <filter class="solr.StandardFilterFactory"/>
    <filter class="solr.LowerCaseFilterFactory"/>
    <filter class="solr.ISOLatin1AccentFilterFactory"/>
    <filter class="solr.PorterStemFilterFactory"/>
  </analyzer>
</fieldType>

然后我执行搜索并使用存储的字段，以便我可以在结果中返回突出显示的文本.我遇到的问题是存储的值中有原始的 html 文本.例如:搜索新闻"正在返回:

I am then performing a search and using a stored field so that I can return highlighted text in the results. The problem I am having is that the stored value has the original html text in it. For example: a search on 'news' is returning:

"与@@@hl@@@news@@@endhl@@@、体育、本地优惠和所有最新对话的社区联系.</div> </div> </div>"

"community connection to @@@hl@@@news@@@endhl@@@, sports, local deals and all the latest conversations.</div> </div> </div>"

然后我想用 html 包装的标签替换标签@@@hl@@@、@@@endhl@@@.

I then want to replace tags @@@hl@@@, @@@endhl@@@ with html wrapped tags.

我是否需要自己手动去除原始 html 标签(div 等)标签，或者有​​没有办法让存储的值已经去除 html 标签?

Do I need to manually strip out the original html tags (divs, etc) tags out myself or is there a way to get the stored value to already have html tags stripped out?

我知道如何手动执行此操作，只是想确保我没有遗漏 schema.xml 或 solrconfig.xml 中的某些内容.

I know how to do this manually, just wanted to make sure I wasn't missing something in the schema.xml or solrconfig.xml.

谢谢

推荐答案

您需要在插入 Solr 之前或从索引检索之后手动去除该数据/格式.Solr 中的 Analyzers、Tokenizers 和 Token Filters 针对该字段运行并针对该值执行其操作在将标记/术语插入该文档的索引之前或在查询处理期间传递.但是，它会始终以传入的原始表单存储用于返回查询结果的字段值.

You will need to manually strip that data/formatting out either prior to inserting into Solr or after retrieving from the index. The Analyzers, Tokenizers, and Token Filters in Solr run against the field and perform their actions against the value passed prior to inserting tokens/terms into the index for that document or during the query processing. However, it will always store the field value for returning with query results in the original form passed in.

如果您碰巧使用 DataImportHandler 将数据加载到 Solr，它提供了一个HtmlStripTransformer 和/或 RegExTransformer 你可以利用它来删除 html 标签.

If you happen to be using the DataImportHandler to load your data into Solr, it provides an HtmlStripTransformer and/or RegExTransformer you could leverage to remove the html tags.

这篇关于Solr 在使用存储的 html 字段突出显示时剥离 html的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！