• Welcome to Sitemap Generator Forum.
 

Robots.txt

Started by jmlecocq, June 02, 2008, 04:51:03 PM

Previous topic - Next topic

jmlecocq

Hi,
I am looking for some assistance on a question I have on a robots.txt file. 

I ran the SE bots simulator tool on this site.  I get a red x infront of two headings.

"Restricted with Robots.txt" and "Restricted with rel="nofollow" attributes.  both report " none found"

my question is what does the red X indicate?  is there a problem in this category?  and, I do have a robots.txt file restricting access to about 5 or 6 folders.  Should these be listed here? 

Thanks you so much for your help, I really appreciate it.

Julie


XML-Sitemaps Support

This is only an icon that means "entries are not included in sitemap", in your case there are no excluded links found.