XML Sitemaps Generator

Author Topic: Generator only crawling homepage  (Read 9046 times)


  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Generator only crawling homepage
« on: June 11, 2011, 11:37:47 AM »
   I've just installed your unlimited sitemap generator after using the free one and finding that one to work well.

I've installed and set it up following the instructions but when I crawl it only crawls the homepage.

I have no robots.txt I have an index, follow meta tag.  Your free sitemap generator can crawl the website and return urls from the homepage.
I'm using standard html a hrefs with no javascript and none of the links are nofollowed.
I've run out of things to check.  I've also used your spider test tool and that returns all of teh links from the hompage ok.

Any ideas?  Is there something I'm doing wrong?  I'd rather not post the url in public but will provide it by PM...

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10916
Re: Generator only crawling homepage
« Reply #1 on: June 11, 2011, 03:47:00 PM »

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


SMF 2.0.14 | SMF © 2017, Simple Machines