windows 安装scrapy

先安装python2.7

python2.7

安装pip

教程:pip

切换到cmd 管理员

C:\Users\wd\Downloads>python get-pip.py

C:\Users\wd\Downloads>python get-pip.pyCollecting pip  Using cached pip-9.0.1-py2.py3-none-any.whlCollecting setuptools  Using cached setuptools-35.0.2-py2.py3-none-any.whlCollecting wheel  Using cached wheel-0.29.0-py2.py3-none-any.whlCollecting appdirs>=1.4.0 (from setuptools)  Using cached appdirs-1.4.3-py2.py3-none-any.whlCollecting packaging>=16.8 (from setuptools)  Using cached packaging-16.8-py2.py3-none-any.whlCollecting six>=1.6.0 (from setuptools)  Using cached six-1.10.0-py2.py3-none-any.whlCollecting pyparsing (from packaging>=16.8->setuptools)  Using cached pyparsing-2.2.0-py2.py3-none-any.whlInstalling collected packages: pip, appdirs, pyparsing, six, packaging, setuptools, wheelSuccessfully installed appdirs-1.4.3 packaging-16.8 pip-9.0.1 pyparsing-2.2.0 setuptools-35.0.2 six-1.10.0 wheel-0.29.0C:\Users\wd\Downloads>pipUsage:  pip <command> [options]Commands:  install                     Install packages.  download                    Download packages.  uninstall                   Uninstall packages.  freeze                      Output installed packages in requirements format.  list                        List installed packages.  show                        Show information about installed packages.  check                       Verify installed packages have compatible dependencies.  search                      Search PyPI for packages.  wheel                       Build wheels from your requirements.  hash                        Compute hashes of package archives.  completion                  A helper command used for command completion.  help                        Show help for commands.General Options:  -h, --help                  Show help.  --isolated                  Run pip in an isolated mode, ignoring                              environment variables and user configuration.  -v, --verbose               Give more output. Option is additive, and can be                              used up to 3 times.  -V, --version               Show version and exit.  -q, --quiet                 Give less output. Option is additive, and can be                              used up to 3 times (corresponding to WARNING,                              ERROR, and CRITICAL logging levels).  --log <path>                Path to a verbose appending log.  --proxy <proxy>             Specify a proxy in the form                              [user:passwd@]proxy.server:port.  --retries <retries>         Maximum number of retries each connection should                              attempt (default 5 times).  --timeout <sec>             Set the socket timeout (default 15 seconds).  --exists-action <action>    Default action when a path already exists:                              (s)witch, (i)gnore, (w)ipe, (b)ackup, (a)bort.  --trusted-host <hostname>   Mark this host as trusted, even though it does                              not have valid or any HTTPS.  --cert <path>               Path to alternate CA bundle.  --client-cert <path>        Path to SSL client certificate, a single file                              containing the private key and the certificate                              in PEM format.  --cache-dir <dir>           Store the cache data in <dir>.  --no-cache-dir              Disable the cache.  --disable-pip-version-check                              Don't periodically check PyPI to determine                              whether a new version of pip is available for                              download. Implied with --no-index.
C:\Users\wd>pip install twisted
C:\>pip install pypiwin32Collecting pypiwin32  Downloading pypiwin32-219-cp27-none-win_amd64.whl (7.3MB)    100% |████████████████████████████████| 7.3MB 164kB/sInstalling collected packages: pypiwin32Successfully installed pypiwin32-219C:\>pip install pillowCollecting pillow  Downloading Pillow-4.1.1-cp27-cp27m-win_amd64.whl (1.4MB)    100% |████████████████████████████████| 1.4MB 365kB/sCollecting olefile (from pillow)  Downloading olefile-0.44.zip (74kB)    100% |████████████████████████████████| 81kB 890kB/sBuilding wheels for collected packages: olefile  Running setup.py bdist_wheel for olefile ... done  Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\20\58\49\cc7bd00345397059149a10b0259ef38b867935ea2ecff99a9bSuccessfully built olefileInstalling collected packages: olefile, pillowSuccessfully installed olefile-0.44 pillow-4.1.1C:\>pip install pymongoCollecting pymongo  Downloading pymongo-3.4.0-cp27-none-win_amd64.whl (267kB)    100% |████████████████████████████████| 276kB 1.1MB/sInstalling collected packages: pymongoSuccessfully installed pymongo-3.4.0

C:\>pip install pypiwin32
Collecting pypiwin32
  Downloading pypiwin32-219-cp27-none-win_amd64.whl (7.3MB)
    100% |████████████████████████████████| 7.3MB 164kB/s
Installing collected packages: pypiwin32
Successfully installed pypiwin32-219


C:\>pip install pillow
Collecting pillow
  Downloading Pillow-4.1.1-cp27-cp27m-win_amd64.whl (1.4MB)
    100% |████████████████████████████████| 1.4MB 365kB/s
Collecting olefile (from pillow)
  Downloading olefile-0.44.zip (74kB)
    100% |████████████████████████████████| 81kB 890kB/s
Building wheels for collected packages: olefile
  Running setup.py bdist_wheel for olefile ... done
  Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\20\58\49\cc7bd00345397059149a10b0259ef38b867935ea2ecff99a9b
Successfully built olefile
Installing collected packages: olefile, pillow
Successfully installed olefile-0.44 pillow-4.1.1


C:\>pip install pymongo
Collecting pymongo
  Downloading pymongo-3.4.0-cp27-none-win_amd64.whl (267kB)
    100% |████████████████████████████████| 276kB 1.1MB/s
Installing collected packages: pymongo
Successfully installed pymongo-3.4.0

C:\>pip install scrapyCollecting scrapy  Downloading Scrapy-1.4.0-py2.py3-none-any.whl (248kB)    100% |████████████████████████████████| 256kB 226kB/sCollecting service-identity (from scrapy)  Downloading service_identity-17.0.0-py2.py3-none-any.whlCollecting parsel>=1.1 (from scrapy)  Downloading parsel-1.2.0-py2.py3-none-any.whlRequirement already satisfied: six>=1.5.2 in c:\program files\python2.7\lib\site-packages (from scrapy)Collecting w3lib>=1.17.0 (from scrapy)  Downloading w3lib-1.17.0-py2.py3-none-any.whlCollecting lxml (from scrapy)  Downloading lxml-3.7.3-cp27-none-win_amd64.whl (3.4MB)    100% |████████████████████████████████| 3.5MB 181kB/sRequirement already satisfied: Twisted>=13.1.0 in c:\program files\python2.7\lib\site-packages (from scrapy)Collecting cssselect>=0.9 (from scrapy)  Downloading cssselect-1.0.1-py2.py3-none-any.whlCollecting PyDispatcher>=2.0.5 (from scrapy)  Downloading PyDispatcher-2.0.5.tar.gzCollecting queuelib (from scrapy)  Downloading queuelib-1.4.2-py2.py3-none-any.whlCollecting pyOpenSSL (from scrapy)  Downloading pyOpenSSL-17.0.0-py2.py3-none-any.whl (51kB)    100% |████████████████████████████████| 61kB 218kB/sCollecting pyasn1 (from service-identity->scrapy)  Downloading pyasn1-0.2.3-py2.py3-none-any.whl (53kB)    100% |████████████████████████████████| 61kB 71kB/sRequirement already satisfied: attrs in c:\program files\python2.7\lib\site-packages (from service-identity->scrapy)Collecting pyasn1-modules (from service-identity->scrapy)  Downloading pyasn1_modules-0.0.8-py2.py3-none-any.whlRequirement already satisfied: Automat>=0.3.0 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: constantly>=15.1 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: incremental>=16.10.1 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)Requirement already satisfied: zope.interface>=3.6.0 in c:\program files\python2.7\lib\site-packages (from Twisted>=13.1.0->scrapy)Collecting cryptography>=1.7 (from pyOpenSSL->scrapy)  Downloading cryptography-1.8.2-cp27-cp27m-win_amd64.whl (1.3MB)    100% |████████████████████████████████| 1.3MB 242kB/sRequirement already satisfied: setuptools in c:\program files\python2.7\lib\site-packages (from zope.interface>=3.6.0->Twisted>=13.1.0->scrapy)Collecting idna>=2.1 (from cryptography>=1.7->pyOpenSSL->scrapy)  Downloading idna-2.5-py2.py3-none-any.whl (55kB)    100% |████████████████████████████████| 61kB 231kB/sCollecting cffi>=1.4.1 (from cryptography>=1.7->pyOpenSSL->scrapy)  Downloading cffi-1.10.0-cp27-cp27m-win_amd64.whl (157kB)    100% |████████████████████████████████| 163kB 251kB/sRequirement already satisfied: packaging in c:\program files\python2.7\lib\site-packages (from cryptography>=1.7->pyOpenSSL->scrapy)Collecting ipaddress (from cryptography>=1.7->pyOpenSSL->scrapy)  Downloading ipaddress-1.0.18-py2-none-any.whlCollecting asn1crypto>=0.21.0 (from cryptography>=1.7->pyOpenSSL->scrapy)  Downloading asn1crypto-0.22.0-py2.py3-none-any.whl (97kB)    100% |████████████████████████████████| 102kB 344kB/sCollecting enum34 (from cryptography>=1.7->pyOpenSSL->scrapy)  Downloading enum34-1.1.6-py2-none-any.whlRequirement already satisfied: appdirs>=1.4.0 in c:\program files\python2.7\lib\site-packages (from setuptools->zope.interface>=3.6.0->Twisted>=13.1.0->scrapy)Collecting pycparser (from cffi>=1.4.1->cryptography>=1.7->pyOpenSSL->scrapy)  Downloading pycparser-2.17.tar.gz (231kB)    100% |████████████████████████████████| 235kB 261kB/sRequirement already satisfied: pyparsing in c:\program files\python2.7\lib\site-packages (from packaging->cryptography>=1.7->pyOpenSSL->scrapy)Building wheels for collected packages: PyDispatcher, pycparser  Running setup.py bdist_wheel for PyDispatcher ... done  Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\86\02\a1\5857c77600a28813aaf0f66d4e4568f50c9f133277a4122411  Running setup.py bdist_wheel for pycparser ... done  Stored in directory: C:\Users\wd\AppData\Local\pip\Cache\wheels\a8\0b\41\dc95621f9d3a0da7bc191b8a71f0e8182ffd3cc5f33ac55005Successfully built PyDispatcher pycparserInstalling collected packages: pyasn1, idna, pycparser, cffi, ipaddress, asn1crypto, enum34, cryptography, pyOpenSSL, pyasn1-modules, service-identity, w3lib, cssselect, lxml, parsel, PyDispatcher, queuelib, scrapySuccessfully installed PyDispatcher-2.0.5 asn1crypto-0.22.0 cffi-1.10.0 cryptography-1.8.2 cssselect-1.0.1 enum34-1.1.6 idna-2.5 ipaddress-1.0.18 lxml-3.7.3 parsel-1.2.0 pyOpenSSL-17.0.0 pyasn1-0.2.3 pyasn1-modules-0.0.8 pycparser-2.17 queuelib-1.4.2 scrapy-1.4.0 service-identity-17.0.0 w3lib-1.17.0C:\Users\wd\Downloads>scrapyScrapy 1.4.0 - no active projectUsage:  scrapy <command> [options] [args]Available commands:  bench         Run quick benchmark test  fetch         Fetch a URL using the Scrapy downloader  genspider     Generate new spider using pre-defined templates  runspider     Run a self-contained spider (without creating a project)  settings      Get settings values  shell         Interactive scraping console  startproject  Create new project  version       Print Scrapy version  view          Open URL in browser, as seen by Scrapy  [ more ]      More commands available when run from project directoryUse "scrapy <command> -h" to see more info about a commandC:\Users\wd\Downloads>