rene3

*
  • *
  • 17
robots.txt ignored by sitemap generator (v7.0)
« on: February 02, 2015, 10:19:00 AM »
Hallo

It looks like sitemap generator does ignore the robotx.txt file ?


I am prette confused..

Read...* wildcards are not allowed in the robots.txt ?

thanks
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #1 on: February 03, 2015, 05:41:19 AM »
Hello,

robots.txt is supported.

What is your robots.txt URL, an example of directive and URL that is added in sitemap?

rene3

*
  • *
  • 17
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #2 on: February 03, 2015, 08:11:38 AM »
I did had som * (wildcards) ...could this be the reason ?

that everthing down from the wildcard got ignored ?

cheers