Very few pages being added to sitemap
« on: October 11, 2015, 05:34:58 AM »
I'm at a loss to explain why this is so.  There are thousands of pages scanned but not added.  robots.txt and the meta tags are not interfering with the indexing of these pages.  Google has no problem crawling these pages.  I'm not sure what information you want.  I looked at other threads that had the same problems but there are no solutions; only private messages.  Using the latest version that I just downloaded today.

Here is a typical page that is not getting added: http://www.stofcheck-ballinger.com/obituaries.php?action=display&id=-100684

My robots.txt file contains this:
Code: [Select]
User-Agent: *
Allow: /
Disallow: /*action=condolence
Disallow: /*action=print
Disallow: /*action=notify
Re: Very few pages being added to sitemap
« Reply #1 on: October 11, 2015, 08:21:29 AM »
Hello,

I've excluded login pages from crawling in your generator settings and it seems to work now.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Very few pages being added to sitemap
« Reply #2 on: October 12, 2015, 12:18:22 AM »
That fixed it.  I don't know why, but it did.  Thanks.