Introduction - If you have any usage issues, please Google them yourself
Search engine crawlers from a series of seed link URL in these initial pages hungry out into the URL queue, and then traverse all the work queue URL, the URL again into the download page and foundwork queue.