Python爬虫（六）爬京东商品图片

来源：互联网发布：网络彩票推广员编辑：程序博客网时间：2024/04/30 14:48

打开京东商城，选择笔记本电脑区域，第一页的链接是 https://list.jd.com/list.html?cat=670,671,672&page=1，第二页page属性就变成了2，以此类推

查看网页源代码，接触过html的人很快就会发现链接图片的标签，格式如下：

<img width="220" height="220" data-img="1" data-lazy-img="//img14.360buyimg.com/n7/jfs/t10123/170/1203650051/249444/b4748f86/59ddb765N62523179.jpg">

那么对应的正则表达式就是

pattern = '<img width="220" height="220" data-img="1" data-lazy-img="//(.+?\.jpg)">'

()是指获取()里面的匹配内容，懒惰模式，只要遇到 . 就结束

代码：获取1-9页的商品图片

import reimport urllib.requestdef catch_pic(url, page):    html = urllib.request.urlopen(url).read()    html = html.decode('utf-8')    pattern = '<img width="220" height="220" data-img="1" data-lazy-img="//(.+?\.jpg)">'    imagelist = re.compile(pattern).findall(html)    x = 1    for imageurl in imagelist:        imagename = "F:/pythonpic/jd_pic/" + str(page) + "_" + str(x) + ".jpg"        imageurl = "http://" + imageurl        try:            urllib.request.urlretrieve(imageurl, filename=imagename)        except urllib.error.URLError as e:            if hasattr(e, "code"):                x += 1            if hasattr(e, "reason"):                x += 1        x += 1for i in range(1, 10):    url = "https://list.jd.com/list.html?cat=670,671,672&page=" + str(i)    catch_pic(url, i)

阅读全文

0 0