关于开源框架Scrapy运行命令Crawl

来源：互联网发布：c语言经典小游戏编程编辑：程序博客网时间：2024/05/22 16:46

翻遍百度上找的博客,都说是用Crawl + spidername(这个是类里面申明name变量) 运行.结果给我表示出这样一个错误:

    cmd.run(args, opts)  File "c:\python27\lib\site-packages\scrapy\commands\crawl.py", line 57, in run    self.crawler_process.crawl(spname, **opts.spargs)  File "c:\python27\lib\site-packages\scrapy\crawler.py", line 167, in crawl    crawler = self.create_crawler(crawler_or_spidercls)  File "c:\python27\lib\site-packages\scrapy\crawler.py", line 195, in create_crawler    return self._create_crawler(crawler_or_spidercls)  File "c:\python27\lib\site-packages\scrapy\crawler.py", line 199, in _create_crawler    spidercls = self.spider_loader.load(spidercls)  File "c:\python27\lib\site-packages\scrapy\spiderloader.py", line 71, in load    raise KeyError("Spider not found: {}".format(spider_name))KeyError: 'Spider not found: fuckSpider'这是我写的一个代码:

-- encoding: UTF-8 --

import scrapy
class fuckSpider(scrapy.Spider):
name = “fuckSpider”
# start_urls是我们准备爬的初始页
start_urls = [
“https://tieba.baidu.com/p/4145325475“,
]

def parse(self, response):      #Callback Function    print response.body.decode('UTF-8')

后来我又改变了运行命令:

C:\Users\Administrator\Desktop\Python\spider\scrapy\spridr_test\spridr_test>scra
py runspider fuckSpider.py
“`

结果真的运行成功了,运行效果太长不展示了!!!（注意：这种方法文件中的类名必须与文件名一样,但不要把扩展名也写进类名）

阅读全文

0 0