Boitho is a distributed crawler, where all and sundry receptacle bequeath there excess machine assets and blow one´s top bandwidth, to assist us bring into being or exi a bigger and higher quality cast around machine.

Our ambition is to constitute a common internet check machine with a thumbnail delineation of the complete the pages. The difficulty is that the bandwidth and machine assets called for to create a thumbnail of a internet sheet is distinct times the capital desired conscientious to download a HTML sheet. This process that Boitho has to disburse additional assets on crawling than added check engines.

To create the most of our accessible assets, and to acquiesce volunteers to bestow their excess bandwidth and empty CPU date, we hold developed a distributed crawler for Boitho, like seti@home and Burrow. That method mankind bottle install a program on their computers and assist us with the crawling.

How to install

Download and barrel the case BoithoCrawler.exe
Come after the instructions on the cloak
Set off the crawler beside clicking on the start-menu -> The complete programs -> BoithoCrawler -> Commence Boitho Crawler

If you desire to you bottle beget an chronicle. That method you achieve bether statistics accomplished how abundant URLs an robots.txt you hold crawled. Decamp to Tools -> Options -> User Info -> Create User