XML Sitemaps Generator

Author Topic: How does XML-sitemap generator identify itself in logs?  (Read 14246 times)

pgmason

  • Approved member
  • *
  • Posts: 1
How does XML-sitemap generator identify itself in logs?
« on: January 27, 2009, 11:49:13 AM »
Hi

How does the online generator identify itself in traffic logs?  What user agent name does it use?  I want to make sure we don't block it in our robots.txt file, as we typically block unidientified spiders.

Thanks

Pete

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: How does XML-sitemap generator identify itself in logs?
« Reply #1 on: January 27, 2009, 11:29:10 PM »
Hello,

sitemap generator User-agent header is:
Mozilla/5.0 (XML Sitemaps Generator 1.0)

It checks the disallow directives in robots.txt for googlebot and "User-agent: *".
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2