XML Sitemaps Generator

Author Topic: Very few pages being added to sitemap  (Read 13498 times)

ggballinger

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Very few pages being added to sitemap
« on: October 11, 2015, 04:34:58 AM »
I'm at a loss to explain why this is so.  There are thousands of pages scanned but not added.  robots.txt and the meta tags are not interfering with the indexing of these pages.  Google has no problem crawling these pages.  I'm not sure what information you want.  I looked at other threads that had the same problems but there are no solutions; only private messages.  Using the latest version that I just downloaded today.

Here is a typical page that is not getting added: [external links are visible to admins only]

My robots.txt file contains this:
Code: [external links are visible to admins only]
User-Agent: *
Allow: /
Disallow: /*action=condolence
Disallow: /*action=print
Disallow: /*action=notify

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Very few pages being added to sitemap
« Reply #1 on: October 11, 2015, 07:21:29 AM »
Hello,

I've excluded login pages from crawling in your generator settings and it seems to work now.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ggballinger

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Very few pages being added to sitemap
« Reply #2 on: October 11, 2015, 11:18:22 PM »
That fixed it.  I don't know why, but it did.  Thanks.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2