Introduction - If you have any usage issues, please Google them yourself
Web crawler (also known as web spider, web robot, FOAF community in the middle, more often referred to as the page chaser), is a follow certain rules to automatically crawl the Web information program or script.