BeautifulSoup和Scrapy履带之间的区别？ [英] Difference between BeautifulSoup and Scrapy crawler?

问题描述

我想打一个网站，显示亚马逊和电子海湾产品价格之间的比较。
其中，这些都将工作得更好，为什么？我有些熟悉的 BeautifulSoup 但没有这么多是 Scrapy履带

I want to make a website that shows the comparison between amazon and e-bay product price. Which of these will work better and why? I am somewhat familiar with BeautifulSoup but not so much with Scrapy crawler.

推荐答案

Scrapy 是一个网络蜘蛛或网页刷屏框架，你给Scrapy根URL启动爬行，那么你可以指定有多少（数量）要爬网并获取等的URL限制。它是网络刮或爬行

Scrapy is a Web-spider or web scraper framework, You give Scrapy a root URL to start crawling, then you can specify constraints on how many (number of) URLs you want to crawl and fetch,etc. It is a complete framework for web-scraping or crawling.

在

BeautifulSoup 为解析库这也确实取出由URL内容的pretty好工作，让你分析其中的某些部分没有任何麻烦。它只是获取你给URL的内容，然后停止。它不会爬行，除非你手动把它与一定的标准无限循环中。

BeautifulSoup is a parsing library which also does a pretty good job of fetching contents from URL and allows you to parse certain parts of them without any hassle. It only fetches the contents of the URL that you give and then stops. It does not crawl unless you manually put it inside an infinite loop with certain criteria.

在简单的话，用美丽的汤，你可以建立类似的东西Scrapy。
美丽的汤是一个库而Scrapy是一个完整的框架

In simple words, with Beautiful Soup you can build something similar to Scrapy. Beautiful Soup is a library while Scrapy is a complete framework.

来源：的http://www.quora.com/Python-programming-language-1/How-is-BeautifulSoup-different-from-Scrapy

这篇关于BeautifulSoup和Scrapy履带之间的区别？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！