Doesn't Crawl Entire Website
« on: January 12, 2011, 07:17:41 PM »
Hi,

I have an eCommerce site that has 800+ products and it doesn't crawl all of them.  It only seems to do a few from each category.  I am using re-write rules so I am not sure if that is the problem.  All the settings are at default.  From my guess I don't have more than 1000 pages.  It is currently indexing 200 or so.

[ External links are visible to forum administrators only ]

Thanks!

Stan
Re: Doesn't Crawl Entire Website
« Reply #1 on: January 13, 2011, 10:13:27 AM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?

erik4

*
  • *
  • 14
Re: Doesn't Crawl Entire Website
« Reply #2 on: January 17, 2011, 06:16:51 PM »
Thanks - - That fixed the issue.