XML Sitemaps Generator

Author Topic: Not indexing all URLS  (Read 10706 times)

chris110

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Not indexing all URLS
« on: November 01, 2013, 11:57:19 PM »
My site is using asp.net. I use the following rewrite/redirect tool to force urls to lowercase, but it prevents some urls from being added to my site map. (If i remove this rule, the sitemap generator works fine-except for the fact that it adds uppercase and lowercase versions of some pages. I need this rule as I just recently standardized my urls to lowercase for SEO)

<rule name="Convert to lowercase"  stopProcessing="true">
           <match url="[A-Z]" ignoreCase="false" />
           <action type="Redirect" url="{ToLower:{URL}}" />
        </rule>

The rewrite works fine. It shows as a 301 and all of my urls are always lowercase. Why is it breaking this sitemap generator and how do I fix it?

chris110

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Not indexing all URLS
« Reply #1 on: November 02, 2013, 12:37:58 AM »
nevermind. I spent hours on this and it ended up being a line in my robot.txt file  :-\

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2