Description: Scrapy is a based on twisted based asynchronous processing framework, pure Python implementation framework of crawler, users only need to custom developed several modules can easily achieve a reptile, used to crawl the web content and various picture, very convenient.
To Search:
File list (Check if you may need any files):
scrapy-1.0.4
............\.bumpversion.cfg
............\.coveragerc
............\.gitignore
............\.travis.yml
............\artwork
............\.......\qlassik.zip
............\.......\README
............\.......\scrapy-blog-logo.xcf
............\.......\scrapy-logo.jpg
............\AUTHORS
............\conftest.py
............\CONTRIBUTING.md
............\debian
............\......\changelog
............\......\compat
............\......\control
............\......\copyright
............\......\pyversions
............\......\rules
............\......\scrapy.docs
............\......\scrapy.install
............\......\scrapy.lintian-overrides
............\......\scrapy.manpages
............\docs
............\....\conf.py
............\....\contributing.rst
............\....\faq.rst
............\....\index.rst
............\....\intro
............\....\.....\examples.rst
............\....\.....\install.rst
............\....\.....\overview.rst
............\....\.....\tutorial.rst
............\....\Makefile
............\....\news.rst
............\....\README
............\....\topics
............\....\......\api.rst
............\....\......\architecture.rst
............\....\......\autothrottle.rst
............\....\......\benchmarking.rst
............\....\......\broad-crawls.rst
............\....\......\commands.rst
............\....\......\contracts.rst
............\....\......\debug.rst
............\....\......\deploy.rst
............\....\......\djangoitem.rst
............\....\......\downloader-middleware.rst
............\....\......\email.rst
............\....\......\exceptions.rst
............\....\......\exporters.rst
............\....\......\extensions.rst
............\....\......\feed-exports.rst
............\....\......\firebug.rst
............\....\......\firefox.rst
............\....\......\item-pipeline.rst
............\....\......\items.rst
............\....\......\jobs.rst
............\....\......\leaks.rst
............\....\......\link-extractors.rst
............\....\......\loaders.rst
............\....\......\logging.rst
............\....\......\media-pipeline.rst
............\....\......\practices.rst
............\....\......\request-response.rst
............\....\......\scrapyd.rst
............\....\......\selectors.rst
............\....\......\settings.rst
............\....\......\shell.rst
............\....\......\signals.rst
............\....\......\spider-middleware.rst
............\....\......\spiders.rst
............\....\......\stats.rst
............\....\......\telnetconsole.rst
............\....\......\ubuntu.rst
............\....\......\webservice.rst
............\....\......\_images
............\....\......\.......\firebug1.png
............\....\......\.......\firebug2.png
............\....\......\.......\firebug3.png
............\....\......\.......\scrapy_architecture.odg
............\....\......\.......\scrapy_architecture.png
............\....\utils
............\....\.....\linkfix.py
............\....\versioning.rst
............\....\_ext
............\....\....\scrapydocs.py
............\....\_static
............\....\.......\selectors-sample1.html
............\extras
............\......\coverage-report.sh
............\......\qps-bench-server.py
............\......\qpsclient.py
............\......\scrapy.1
............\......\scrapy_bash_completion
............\INSTALL
............\LICENSE
............\Makefile.buildbot
............\MANIFEST.in