使用 Scrapy 解析杂散文本 [英] Parsing stray text with Scrapy

问题描述

知道如何从这段标记中提取TEXT TO GRAB":

Any idea how to extract 'TEXT TO GRAB' from this piece of markup:

<span class="navigation_page">
    <span>
        <a itemprop="url" href="http://www.example.com">
            <span itemprop="title">LINK</span>
        </a>
    </span>
    <span class="navigation-pipe">&gt;</span>
    TEXT TO GRAB
</span>

推荐答案

这不是一个理想的解决方案，但它应该能解决问题:

It's not an ideal solution but it should do the trick:

from scrapy import Selector

content="""
<span class="navigation_page">
    <span>
        <a itemprop="url" href="http://www.example.com">
            <span itemprop="title">LINK</span>
        </a>
    </span>
    <span class="navigation-pipe">&gt;</span>
    TEXT TO GRAB
</span>
"""
sel = Selector(text=content)
item = sel.css(".navigation_page::text")
print(item.extract()[-1].strip())

或者像这样:

sel = Selector(text=content)
item = ''.join([' '.join(items.split()) for items in sel.css("span.navigation_page::text").extract()])
print(item)

输出:

TEXT TO GRAB

这篇关于使用 Scrapy 解析杂散文本的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！