不存在scrapy设置 [英] scrapy setting is not existed
本文介绍了不存在scrapy设置的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
我的蜘蛛中有这行代码
settings.overrides['JOBDIR']= self.domain+"_"+self.Category+"_"+self.Action
我收到此错误:
__
settings.overrides['JOBDIR']= self.domain+"_"+self.Category+"_"+self.Action
NameError: global name 'settings' is not defined
我从这样的脚本运行我的蜘蛛:
I run my spider from a script like this:
def setup_crawler(domain):
spider = GeneralSpider(xmlFile=domain)
settings = get_project_settings()
crawler = Crawler(settings)
crawler.configure()
crawler.crawl(spider)
crawler.start()
推荐答案
get_project_settings()
查找要设置的环境变量 SCRAPY_SETTINGS_MODULE
.确保它已在您的环境中设置.文档此处 解释了如何设置它.
get_project_settings()
looks for the environment variable SCRAPY_SETTINGS_MODULE
to be set. Make sure it is set in your environment. The documentation here explains how to set it.
这篇关于不存在scrapy设置的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文