XML Sitemaps Generator

Author Topic: Website+Vbulletin forum, The Crawler times out  (Read 9485 times)

parmdeep1

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Website+Vbulletin forum, The Crawler times out
« on: February 25, 2011, 05:00:50 PM »
Hi,

We have recently installed the latest Sitemap Generator and having issues in generating the sitemaps automatically. The Crawler doesn't crawls more than 10000 pages. It has only generated one sitemap by Manual Crawling in which we have llimited the number of crawl pages to 1000.

Please advice.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Website+Vbulletin forum, The Crawler times out
« Reply #1 on: February 26, 2011, 08:34:17 AM »
Hello,

make sure that you have selected "URLs exclusion preset" for vBulletin in generator configuration.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

parmdeep1

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Website+Vbulletin forum, The Crawler times out
« Reply #2 on: February 26, 2011, 08:29:39 PM »
Thanks Oleg. We will test it out.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2