Missing Pages in Unlimited Sitemap Generator
« on: February 13, 2009, 12:12:09 PM »
The generator is not picking up some of my files...

Sitemap is www.forafters.co.uk/sitemal.xml

Generator location is: www.forafters.co.uk/generator

here is an example of a missing url: http://www.forafters.co.uk/Products/Blindfold-Mask.html

These are located in a special non-stocked category which links from the home page to here: http://www.forafters.co.uk/cat_non-stocked.html but has been programmed not to show up using the search facility on the site

Re: Missing Pages in Unlimited Sitemap Generator
« Reply #1 on: February 13, 2009, 12:32:53 PM »
Hello,

you have the following in your robots.txt file:
Disallow: /index.php?app=

That line restricts access to pagination links on your site, so not all pages are available.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Missing Pages in Unlimited Sitemap Generator
« Reply #2 on: February 13, 2009, 12:33:45 PM »
Hi, thanks for that .....