使用带有span标签的BeautifulSoup提取特定数据 [英] Extracting particular data with BeautifulSoup with span tags

问题描述

我有这个结构.

<div id="one" class="tab-pane active">
 <div class="item-content">
     <a href="/mobilni-uredjaji.4403.html">
         <div class="item-primary">
                 <div class="sticker-small">
                       <span class=""></span>
                  </div>
                  <div class="sticker-small-lte">
                      <span class="lte"></span>
                  </div>

                 <div class="item-photo">
                          <img src="/upload/images/thumbs/devices/SAMG935F/SAMG935F_image001_220x230.png" alt="Samsung Galaxy S7 edge">
                 </div>


                <div class="item-labels">
                   <span class="item-manufacturer">Samsung</span>
                   <span class="item-title">Galaxy S7 edge</span>
                </div>
      </div>

       <div class="item-secondary">
                <span class="item-price">94.000<span class="currency">currency!</span></span>
                <span class="item-package"> uz! Sigurica 1500</span>
                <span class="item-installments">na! 24 rate_po!</span>
                <span class="value">100 currency!</span>
               <span class="item-available">device_is_available_on_webshop_list!</span>
      </div>

    </a>
 </div>
 <div class="item-content">
     <a href="/mobilni-uredjaji.4403.html">
         <div class="item-primary">
                 <div class="sticker-small">
                       <span class=""></span>
                  </div>
                  <div class="sticker-small-lte">
                      <span class="lte"></span>
                  </div>

                 <div class="item-photo">
                          <img src="/upload/images/thumbs/devices/SAMG935F/SAMG935F_image001_220x230.png" alt="Samsung Galaxy S7 edge">
                 </div>


                <div class="item-labels">
                   <span class="item-manufacturer">Samsung</span>
                   <span class="item-title">Galaxy S7 edge</span>
                </div>
      </div>

       <div class="item-secondary">
                <span class="item-price">94.000<span class="currency">currency!</span></span>
                <span class="item-package"> uz! Sigurica 1500</span>
                <span class="item-installments">na! 24 rate_po!</span>
                <span class="value">100 currency!</span>
               <span class="item-available">device_is_available_on_webshop_list!</span>
      </div>

    </a>
 </div>
 
 -----same structure ----
 
</div> 

我的目标是具有class ="item-labels"和相应数据的div:

My target is div with class="item-labels" with corresponding data:

• 三星
• Galaxy S7 edge

和div类别为"item-secondary"的div，其数据在span标记下，类别为"item-price"，为94.000.

and div with class "item-secondary" with data under the span tag with class="item-price", 94.000.

我需要我的输出是准确的:

I need my output to be exactly:

• 三星
• Galaxy S7 edge
• 94000

到目前为止，使用此代码，我正在获得前两个数据，而价格却没有超出范围.我有点卡在这里，因为我已经有一段时间没刮了. 请提示吗? 代码是:

So far with this code i am getting first two data without price under the span. I am kinda stuck here because i haven't done scraping quite a while. Please hint? Code is:

from bs4 import BeautifulSoup
import re
import pymysql
import MySQLdb
import urllib

#rl = "http://www.vipmobile.rs/mobilni-uredjaji.2631.html#tarifgroup-1|devicetype-1|minprice-0|maxprice-124800|brand-0|model-0"
url = "file:///C:/Users/zika/Desktop/one.html"



html = urllib.urlopen(url)
page = html.read()
#print(page)
# db = MySQLdb.connect(host = 'localhost',
                     # user = 'root',
                     # passwd = '123456',
                     # db = 'lyrics')
soup = BeautifulSoup(page, 'html.parser')

#mobData = soup.find("div", {"class": "bxslider items"}).find_all("div", {"class": "item-content"})
#for mobMan in soup.find("div", {"class": "tab-pane active"}).findAll("span")

labelData =  soup.find("div", {"class": "tab-pane active"}).find_all("div", {"class": "item-content"})
labelPrice = soup.find("div", {"class": "tab-pane active"}).find_all("span", class_="item-price")

 
for label in labelData:
print(label.contents[1].find("div", {"class": "item-labels"}).getText())
	
for price in labelPrice:
    print(price.getText())


	
	
	


 
    	

    






		
		
		

input("\n\nPress the enter key to exit!")		

推荐答案

您可以尝试:

from bs4 import BeautifulSoup

soup = BeautifulSoup(source, "html.parser")
div1 = soup.find("div", { "class" : "item-labels" }).findAll('span', { "class" : "item-manufacturer" })
div2 = soup.find("div", { "class" : "item-labels" }).findAll('span', { "class" : "item-title" })
div3 = soup.find("div", { "class" : "item-secondary" }).findAll('span', { "class" : "item-price" })
for i,j,k in zip(div1,div2,div3):
    print i.text
    print j.text
    print k.text.replace("currency!",'')

注意:与上述代码中的source一样，我使用了您在帖子中提供的结构.

Note: as source in the above code I used the structure you provided in your post.

这将给出以下输出:

Samsung
Galaxy S7 edge
94.000

这篇关于使用带有span标签的BeautifulSoup提取特定数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！