XML Sitemaps Generator

Author Topic: not the whole site is being spidered  (Read 8414 times)

william1

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
not the whole site is being spidered
« on: April 13, 2010, 07:43:13 PM »
Hi All

I have noticed that not all the pages on my site are being spidered by XML-sitemaps.

Any ideas?

Ww
« Last Edit: April 13, 2010, 07:45:06 PM by william1 »

xml-sitemaps

  • Administrator
  • Sr. Member
  • *****
  • Posts: 146
    • XML-Sitemaps.com
Re: not the whole site is being spidered
« Reply #1 on: April 14, 2010, 04:37:36 PM »
Hi, make sure you have links to these pages otherwise they won't be found.

You can also try our search engine robot simulator to see how robots view your site.

http://www.xml-sitemaps.com/se-bot-simulator.html
Philip Nicosia
www.xml-sitemaps.com

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2