XML Sitemaps Generator

Author Topic: Only crawls one URL - the homepage  (Read 14520 times)

sales469

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Only crawls one URL - the homepage
« on: September 04, 2008, 01:29:50 PM »
Hello,

I have installed the latest version (2.9) on a site.  I have run the crawl and it only crawls the homepage.

I have searched these forums but not found an answer.

Can someone please explain? 

There should be thousands of URLs.  I bought this software because the CoffeCup software is limited to a few thousand URLs and I needed something capable of crawling large sites.

Thanks.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Only crawls one URL - the homepage
« Reply #1 on: September 04, 2008, 07:04:50 PM »
Hello,

please check your site with search engine robot simulator tool to make sure that your pages are crawlable: http://www.xml-sitemaps.com/se-bot-simulator.html
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2