XML Sitemaps Generator

Author Topic: looks like robots.txt does not get counted  (Read 5781 times)

rene3

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 17
looks like robots.txt does not get counted
« on: April 03, 2015, 01:45:23 PM »
I have this in robots.txt

Disallow: /Impressum/
Disallow: /agb/
Disallow: /Nach-Hersteller/
Disallow: /nach-Kategorie/

Ultimate Generator does ignore them...

what could be wrong




rene3

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 17
Re: looks like robots.txt does not get counted
« Reply #1 on: April 03, 2015, 04:05:52 PM »
robots.txt

is case sensitiv...

oxid produces upper and lowercase...

this helped

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: looks like robots.txt does not get counted
« Reply #2 on: April 04, 2015, 06:35:43 AM »
Hello,

I'm glad you got it working.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2