python不定几率出现httplib.BadStatusLine: ''

来源:互联网 发布:thinkphp5商城源码 编辑:程序博客网 时间:2024/05/16 19:02
Traceback (most recent call last):
  File "/home/appleyuchi/coai/src/merge/xiami_request/search_songs_request.py", line 32, in <module>
    result=search_songs_request(searchword)
  File "/home/appleyuchi/coai/src/merge/xiami_request/search_songs_request.py", line 26, in search_songs_request
    res_data = urllib2.urlopen(req)
  File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python2.7/urllib2.py", line 429, in open
    response = self._open(req, data)
  File "/usr/lib/python2.7/urllib2.py", line 447, in _open
    '_open', req)
  File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 1228, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "/usr/lib/python2.7/urllib2.py", line 1201, in do_open
    r = h.getresponse(buffering=True)
  File "/usr/lib/python2.7/httplib.py", line 1136, in getresponse
    response.begin()
  File "/usr/lib/python2.7/httplib.py", line 453, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python2.7/httplib.py", line 417, in _read_status
    raise BadStatusLine(line)
httplib.BadStatusLine: ''
[Finished in 0.3s with exit code 1]
[shell_cmd: python -u "/home/appleyuchi/coai/src/merge/xiami_request/search_songs_request.py"]
[dir: /home/appleyuchi/coai/src/merge/xiami_request]

[path: /home/appleyuchi/bin:/home/appleyuchi/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin]



错误是不定几率出现的,有时候出现,有时候不出现,一开始我有点慌了。

解决方案如下:

根据下面参考链接来获取User Agent

http://blog.csdn.net/pop_rain/article/details/73178223


   根据 http://www.useragentstring.com/     
   获得user-agent以后,在python代码中补充headers,填入在这个网站查到的user-agent的“值”即可,headers在python中是字典类型,也就是所谓的“键-值”对

“键”是User-Agent,

”值“是


Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36

然后,代码由

原来的

req = urllib2.Request(url)

res_data = urllib2.urlopen(req)

res = res_data.read()

改为:


headers = { 'User-Agent':'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36' }  
req = urllib2.Request(url,"",headers)
res_data = urllib2.urlopen(req)

res = res_data.read()




注意:
上面的红色字体是从上面的参考链接中http://www.useragentstring.com/得到的,填进去即可。
urllib2.urlopen的完整用法是
req = urllib2.Request(url, data, headers)
所以原来没有数据要传的话,那么data部分直接留空,也就是""即可。





原创粉丝点击