Description: Node.js to develop a Baidu cloud sharing crawler project. At the same time, it is a simple and efficient nodejs crawler model.
There are several open source projects on the GitHub, but only provide part of the project in reptiles, reptiles basis also increased to save data, build elasticsearch index module, can be used in the real production environment, but still need to develop their own web module.
To Search:
File list (Check if you may need any files):
yunshare-master
...............\.babelrc
...............\.editorconfig
...............\.eslintrc.js
...............\.gitignore
...............\.vscode
...............\.......\launch.json
...............\data
...............\....\album.json
...............\....\fan.json
...............\....\follow.json
...............\....\hot.json
...............\....\mapping.json
...............\....\share.json
...............\....\urls.sh
...............\....\wap.html
...............\dict
...............\....\custom
...............\....\......\mydict.dic
...............\....\......\single_word_low_freq.dic
...............\dist
...............\....\elastic.js
...............\....\fan.js
...............\....\follow.js
...............\....\indexer.js
...............\....\models
...............\....\......\index.js
...............\....\......\Share.js
...............\....\......\User.js
...............\....\parser
...............\....\parser.js
...............\....\......\ShareParser.js
...............\....\......\UserParser.js
...............\....\......\YunParser.js
...............\....\script
...............\....\......\clean.js
...............\....\......\create.js
...............\....\......\data.js
...............\....\......\init.js
...............\....\......\migrate.js
...............\....\......\mongo.js
...............\....\......\move.js
...............\....\......\sa.js
...............\....\......\sqlite.js
...............\....\......\stom.js
...............\....\......\test.js
...............\....\......\torrent.js
...............\....\share.js
...............\....\update
...............\....\update.js
...............\....\......\Indexer.js
...............\....\......\Update.js
...............\....\user.js
...............\....\util
...............\....\....\fetch.js
...............\....\....\fetch1.js
...............\....\....\files.js
...............\....\....\pool.js
...............\....\worker
...............\....\......\ElasticWorker.js
...............\....\......\FanWorker.js
...............\....\......\FollowWorker.js
...............\....\......\ShareWorker.js
...............\....\yun.js
...............\gulpfile.babel.js
...............\package.json
...............\process.json
...............\README.md
...............\src
...............\...\elastic.js
...............\...\fan.js
...............\...\follow.js
...............\...\models
...............\...\......\index.js
...............\...\......\Share.js
...............\...\......\User.js
...............\...\parser
...............\...\parser.js
...............\...\......\ShareParser.js
...............\...\......\UserParser.js
...............\...\script
...............\...\......\create.js
...............\...\......\init.js
...............\...\share.js
...............\...\util
...............\...\....\fetch.js
...............\...\....\pool.js
...............\...\worker
...............\...\......\ElasticWorker.js
...............\...\......\FanWorker.js
...............\...\......\FollowWorker.js
...............\...\......\ShareWorker.js
...............\yarn.lock
璇存槑.htm
Download