XML Sitemaps Generator

Author Topic: robots.txt - error  (Read 10087 times)

norbert1

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
robots.txt - error
« on: July 14, 2015, 07:46:59 AM »
I had the version 6 installed. In my robots.txt I had the following lines:

User-agent: *
Disallow: /fotos2/
...

/fotos2 is my old gallery-folder, /fotos my new one.

When the sitemap.xml, ror.xml, sitemap_images.xml are generated, /fotos (and of course /fotos2) - folders and subdirectories are not included! I checked my robots.txt by the robots-Tool of google-webmaster and all tets were fine. When I delete the line /fotos2/ all folders and subdirectories of /fotos/ and /fotos2/ are included!

Then I updated from version 6 to 7 (newest version) and I have the same problem.

When I stated /fotos2 in excluded URLs all subdirectories of /fotos2 are included, when I have not the line Disallow: /fotos2/ in robots.txt .

How can I handle this?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: robots.txt - error
« Reply #1 on: July 15, 2015, 06:01:19 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2