XML Sitemaps Generator

Author Topic: robots.txt ignored by sitemap generator (v7.0)  (Read 6061 times)

rene3

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 17
robots.txt ignored by sitemap generator (v7.0)
« on: February 02, 2015, 10:19:00 AM »
Hallo

It looks like sitemap generator does ignore the robotx.txt file ?


I am prette confused..

Read...* wildcards are not allowed in the robots.txt ?

thanks

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #1 on: February 03, 2015, 05:41:19 AM »
Hello,

robots.txt is supported.

What is your robots.txt URL, an example of directive and URL that is added in sitemap?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

rene3

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 17
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #2 on: February 03, 2015, 08:11:38 AM »
I did had som * (wildcards) ...could this be the reason ?

that everthing down from the wildcard got ignored ?

cheers

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #3 on: February 03, 2015, 08:34:10 AM »
Wildcards are supported.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2