XML Sitemaps Generator

Author Topic: Robots.txt  (Read 18008 times)

jmlecocq

  • Approved member
  • *
  • Posts: 2
Robots.txt
« on: June 02, 2008, 03:51:03 PM »
Hi,
I am looking for some assistance on a question I have on a robots.txt file. 

I ran the SE bots simulator tool on this site.  I get a red x infront of two headings.

"Restricted with Robots.txt" and "Restricted with rel="nofollow" attributes.  both report " none found"

my question is what does the red X indicate?  is there a problem in this category?  and, I do have a robots.txt file restricting access to about 5 or 6 folders.  Should these be listed here? 

Thanks you so much for your help, I really appreciate it.

Julie


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Robots.txt
« Reply #1 on: June 02, 2008, 09:55:44 PM »
This is only an icon that means "entries are not included in sitemap", in your case there are no excluded links found.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2