PYTHON3.6+PYCHARM 爬虫

1.分分钟扒一个网页下来

import urllib.requestrequest= urllib.request.Request("http://www.baidu.com")response = urllib.request.urlopen(request)print(response.read())

4.POST和GET数据传送

POST方式无法实现

GET方式：

#使用get的方式传送import urllib.parseimport urllib.requestvalues = {}values['username'] = "账号"values['password'] = "********"data = urllib.parse.urlencode(values)url = "http://passport.csdn.net/account/login?from=http://my.csdn.net/my/mycsdn"request = urllib.request.Request(url+'?'+data)response = urllib.request.urlopen(request)print(response.read())