Robots.txt
« on: June 02, 2008, 04:51:03 PM »
Hi,
I am looking for some assistance on a question I have on a robots.txt file. 

I ran the SE bots simulator tool on this site.  I get a red x infront of two headings.

"Restricted with Robots.txt" and "Restricted with rel="nofollow" attributes.  both report " none found"

my question is what does the red X indicate?  is there a problem in this category?  and, I do have a robots.txt file restricting access to about 5 or 6 folders.  Should these be listed here? 

Thanks you so much for your help, I really appreciate it.

Julie

Re: Robots.txt
« Reply #1 on: June 02, 2008, 10:55:44 PM »
This is only an icon that means "entries are not included in sitemap", in your case there are no excluded links found.