Doesn't Crawl Entire Website
« on: January 12, 2011, 07:17:41 PM »

I have an eCommerce site that has 800+ products and it doesn't crawl all of them.  It only seems to do a few from each category.  I am using re-write rules so I am not sure if that is the problem.  All the settings are at default.  From my guess I don't have more than 1000 pages.  It is currently indexing 200 or so.

[ External links are visible to forum administrators only ]


Re: Doesn't Crawl Entire Website
« Reply #1 on: January 13, 2011, 10:13:27 AM »

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


  • *
  • 10
Re: Doesn't Crawl Entire Website
« Reply #2 on: January 17, 2011, 06:16:51 PM »
Thanks - - That fixed the issue.