Introduction - If you have any usage issues, please Google them yourself
This book explains how to use P in lOil to write a web crawler program, including the introduction of web crawler, from three kinds of methods to grab the data page, extract the data in the cache, the use of multiple threads and processes for concurrent crawl, how to crawl dynamic content, interact with the form, page processing the verification code, and the use of Scarpy and Portia for data capture, data capture technology and in final use this book introduces on several real-world sites were designed to help the reader grasp, book of learning and using technology. This book is suitable for readers with some Python programming experience and readers interested in crawling technology.