not the whole site is being spidered
« on: April 13, 2010, 08:43:13 PM »
Hi All

I have noticed that not all the pages on my site are being spidered by XML-sitemaps.

Any ideas?

Ww
« Last Edit: April 13, 2010, 08:45:06 PM by william1 »
Re: not the whole site is being spidered
« Reply #1 on: April 14, 2010, 05:37:36 PM »
Hi, make sure you have links to these pages otherwise they won't be found.

You can also try our search engine robot simulator to see how robots view your site.

https://www.xml-sitemaps.com/se-bot-simulator.html
Philip Nicosia