Description: A web crawler using java prepared to support concurrency, but because there is crawling too fast, while being shielded
To Search:
File list (Check if you may need any files):
NewCrawler
..........\.classpath
..........\.project
..........\.settings
..........\.........\org.eclipse.jdt.core.prefs
..........\bin
..........\...\Crawler.class
..........\...\Fill.class
..........\...\IO
..........\...\..\ConnectionFactory.class
..........\...\..\Dao.class
..........\...\..\IOAppend.class
..........\...\JsonParser.class
..........\...\Master.class
..........\lib
..........\...\jsoup-1.6.3.jar
..........\...\mysql-connector-java-5.1.7-bin.jar
..........\...\org.json.jar
..........\src
..........\...\Crawler.java
..........\...\Fill.java
..........\...\IO
..........\...\..\ConnectionFactory.java
..........\...\..\Dao.java
..........\...\..\IOAppend.java
..........\...\JsonParser.java
..........\...\Master.java
..........\VisitedUrl.txt
Download