Description: The implementation of a Web crawler, including the discovery of the collection of the URL in the station list and outside the station URL and follow the politeness principle and generates log files, and identity to the server that contains the set of basic parameters
To Search:
File list (Check if you may need any files):
Crawler\build\classes\Crawler\Crawler$HTMLParse.class
.......\.....\.......\.......\Crawler$Parser.class
.......\.....\.......\.......\Crawler.class
.......\.....\.......\.......\form.txt
.......\.....\.......\.......\urlFile.txt
.......\.....\.......\.......\urlOuterFile.txt
.......\build.xml
.......\manifest.mf
.......\nbproject\build-impl.xml
.......\.........\genfiles.properties
.......\.........\private\private.properties
.......\.........\.......\private.xml
.......\.........\project.properties
.......\.........\project.xml
.......\src\Crawler\Crawler.java
.......\...\.......\form.txt
.......\...\.......\urlFile.txt
.......\...\.......\urlOuterFile.txt
.......\build\classes\Crawler
.......\.....\classes
.......\nbproject\private
.......\src\Crawler
.......\build
.......\nbproject
.......\src
Crawler
Download