Douban_Crawler Learning Notes

来源:互联网 发布:苹果手机连不起4g网络 编辑:程序博客网 时间:2024/05/29 16:47

github address

A rookie crawler in Python. The code is such a mess. But I am tired of arrange it. 

This is my first python project. I did it to get familiar with the Python language. It is really lame that I did not think it though. So, I modify it many times. Now, I got this mess. Though my job of crawling douban is done,  this is a shame. I really should think it through before start.

In this little project, I use pysql, requests, regex, threading, exceptions, io with file, etc. Anyway, now I am much  more familiar with Python. So, keep moving!