robots.txt file
« on: February 28, 2008, 10:40:15 PM »
Can anyone help me? Is there a robots.txt file generator I can use? I hear this helps with your sitemap file...?
Re: robots.txt file
« Reply #1 on: February 28, 2008, 11:42:38 PM »
You can simply create text file in notepad, enter the following in it:
Code: [ External links are visible to forum administrators only ]
Sitemap: http://www.yourdomain.com/sitemap.xmlsave as "robots.txt" and upload into your domain root (I assume that you've already created and uploaded sitemap.xml).
Re: robots.txt file
« Reply #2 on: March 16, 2008, 06:53:23 PM »
Hello. I use a tool called Robot-Manager. You can read more about it and buy a copy at the following website:

[ External links are visible to forum administrators only ]

Good luck!

Sylwia

*
Re: robots.txt file
« Reply #3 on: April 19, 2008, 11:27:11 PM »
yahoo also read sitemap path from robots.txt??