Almost the entire folder not crawled
« on: September 10, 2011, 12:32:58 PM »
I'm having a problem with just one folder. Basically a page in a folder is not added in the sitemap.

I have checked exclusion and robots.txt, and it seems everything is ok. Please could you address me to the right way to find the cause?

Re: Almost the entire folder not crawled
« Reply #1 on: September 11, 2011, 03:30:59 PM »

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?