XML Sitemaps Generator

Author Topic: Only crawls one URL - the homepage  (Read 14381 times)


  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Only crawls one URL - the homepage
« on: September 04, 2008, 01:29:50 PM »

I have installed the latest version (2.9) on a site.  I have run the crawl and it only crawls the homepage.

I have searched these forums but not found an answer.

Can someone please explain? 

There should be thousands of URLs.  I bought this software because the CoffeCup software is limited to a few thousand URLs and I needed something capable of crawling large sites.


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10599
Re: Only crawls one URL - the homepage
« Reply #1 on: September 04, 2008, 07:04:50 PM »

please check your site with search engine robot simulator tool to make sure that your pages are crawlable: http://www.xml-sitemaps.com/se-bot-simulator.html
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


SMF 2.0.12 | SMF © 2014, Simple Machines