Description: The following is a Java reptiles, it can start from the specified Home to crawl pages under the domain name of the site in accordance with the specified depth and maintain a simple index.
To Search:
File list (Check if you may need any files):
readme.txt
GetWeb.java
Download