Scrapy CSRF cookies not accepted and results in a 302 Redirect

来源:互联网 发布:软件缺陷预测技术 编辑:程序博客网 时间:2024/06/07 07:16

http://stackoverflow.com/questions/19057746/scrapy-csrf-cookies-not-accepted-and-results-in-a-302-redirect

from scrapy.http import FormRequestfrom scrapy.spider import BaseSpiderclass LoginSpider(BaseSpider):    name = 'pinterest'    start_urls = ['https://www.pinterest.com/login/']    # you can set the user agent either in the settings or the spider    user_agent = ('Mozilla/5.0 (iPhone; CPU iPhone OS 5_0 like Mac OS X) '                  'AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 '                  'Mobile/9A334 Safari/7534.48.3')    def parse(self, response):        data = {'email': 'XXX@xxx', 'password': 'xxx'}        # no need for dont_filter        return FormRequest.from_response(response, formdata=data, callback=self.after_login)    def after_login(self, response):        print response.url


http://stackoverflow.com/questions/16945256/scrapy-and-cookie-handling

yield Request("http://www.sas.no", cookies={    'foo': 'bar'}, callback=self.nextfunction)

0 0