Missing Pages in Unlimited Sitemap Generator
« on: February 13, 2009, 12:12:09 PM »
The generator is not picking up some of my files...

Sitemap is [ External links are visible to forum administrators only ]

Generator location is: [ External links are visible to forum administrators only ]

here is an example of a missing url: [ External links are visible to forum administrators only ]

These are located in a special non-stocked category which links from the home page to here: [ External links are visible to forum administrators only ] but has been programmed not to show up using the search facility on the site

Re: Missing Pages in Unlimited Sitemap Generator
« Reply #1 on: February 13, 2009, 12:32:53 PM »
Hello,

you have the following in your robots.txt file:
Disallow: /index.php?app=

That line restricts access to pagination links on your site, so not all pages are available.
Re: Missing Pages in Unlimited Sitemap Generator
« Reply #2 on: February 13, 2009, 12:33:45 PM »
Hi, thanks for that .....