Website+Vbulletin forum, The Crawler times out

[parmdeep1]

Hi,

We have recently installed the latest Sitemap Generator and having issues in generating the sitemaps automatically. The Crawler doesn't crawls more than 10000 pages. It has only generated one sitemap by Manual Crawling in which we have llimited the number of crawl pages to 1000.

Please advice.

[XML-Sitemaps Support]

Hello,

make sure that you have selected "URLs exclusion preset" for vBulletin in generator configuration.

[parmdeep1]

Thanks Oleg. We will test it out.