Introduction - If you have any usage issues, please Google them yourself
a Web Crawler (robots, spiders) Java class libraries, initially by the Carnegie Mellon University's Robert Miller development. Supports multi-threading, HTML parsing URL filtering, and the page configuration, pattern matching, image, and so on.