不存在scrapy设置 [英] scrapy setting is not existed

查看:40
本文介绍了不存在scrapy设置的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我的蜘蛛中有这行代码

settings.overrides['JOBDIR']= self.domain+"_"+self.Category+"_"+self.Action

我收到此错误:

__
    settings.overrides['JOBDIR']= self.domain+"_"+self.Category+"_"+self.Action
NameError: global name 'settings' is not defined

我从这样的脚本运行我的蜘蛛:

I run my spider from a script like this:

def setup_crawler(domain):
    spider = GeneralSpider(xmlFile=domain)
    settings = get_project_settings()
    crawler = Crawler(settings)
    crawler.configure()
    crawler.crawl(spider)
    crawler.start()

推荐答案

get_project_settings() 查找要设置的环境变量 SCRAPY_SETTINGS_MODULE.确保它已在您的环境中设置.文档此处 解释了如何设置它.

get_project_settings() looks for the environment variable SCRAPY_SETTINGS_MODULE to be set. Make sure it is set in your environment. The documentation here explains how to set it.

这篇关于不存在scrapy设置的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆