Description: Write himself reptiles, simple implementation, without considering the distributed and cloud computing, but the use of the in-memory database
To Search:
File list (Check if you may need any files):
.classpath
.project
.settings
.........\org.eclipse.jdt.core.prefs
bin
...\DownLoadFile.class
...\HtmlParserTool$1.class
...\HtmlParserTool.class
...\LinkFilter.class
...\LinkQueue.class
...\MD5.class
...\MyCrawler$1.class
...\MyCrawler.class
...\Queue.class
...\TODO
...\....\AbstractFrontier.class
...\....\BDBFrontier.class
...\....\CrawlUrl.class
...\....\Frontier.class
...\Visited
...\.......\SimpleBloomFilter$SimpleHash.class
...\.......\SimpleBloomFilter.class
DB
..\00000000.jdb
..\je.config.csv
..\je.info.0
..\je.info.0.lck
..\je.lck
..\je.stat.csv
src
...\DownLoadFile.java
...\HtmlParserTool.java
...\LinkFilter.java
...\LinkQueue.java
...\MD5.java
...\MyCrawler.java
...\Queue.java
...\TODO
...\....\AbstractFrontier.java
...\....\BDBFrontier.java
...\....\CrawlUrl.java
...\....\Frontier.java
...\Visited
...\.......\SimpleBloomFilter.java
Download