How to increase crawl speed ?
« on: October 29, 2011, 12:56:39 PM »
Hello,

Crawl speed is very low, and my website have more than 100 000 pages, how can i increase crawl speed ?

Thx
Re: How to increase crawl speed ?
« Reply #1 on: October 30, 2011, 05:09:14 PM »
Hello,
normally it's possible to use "do not parse" setting to add some urls directly to sitemap without crawling to speed-up generator. Please let me know your generator URL/login in PM to check this.