Description: a Web Crawler (robots, spiders) Java class libraries, initially by the Carnegie Mellon University's Robert Miller development. Supports multi-threading, HTML parsing URL filtering, and the page configuration, pattern matching, image, and so on.
File list (Check if you may need any files):