XML Sitemaps Generator

Author Topic: Crawling only menu links  (Read 23865 times)


  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Crawling only menu links
« on: April 15, 2007, 11:23:16 AM »

I've just purchased the stand alone sitemap generator and have found it invaluable for finding broken links - it's worth the money just for that facility alone. I have a number of sites and have an issue with just one of them. On this one site ([external links are visible to admins only]) the crawl is only finding menu links - it doesn't crawl the links on the pages and as such is only returning 6 pages on a site of 200 plus. It's obviously something in the code on the pages but there are no no-follow tags and as far as I can see no other reasons for limiting the crawl.

Can you take a look and advise please



XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10599
Re: Crawling only menu links
« Reply #1 on: April 16, 2007, 02:47:30 AM »

thank you for your kind words.

U just tried to crawl your site and generator has found many pages successfully.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


SMF 2.0.12 | SMF © 2014, Simple Machines