Toggle navigation
PRO Sitemaps
Standalone Generator
About Sitemaps
News
SEO Tools
Sitemap Generator Forum
Guest
Login
Register
Menu
Home
Help
Search
Login
Register
XML Sitemaps Discussions Category
/
Site maps - General Discussion
/
robots.txt file
Competitor Analysis Tool:
Analyze rival websites and gain valuable SEO and PPC insights
« previous
next »
Pages:
1
royski
1
robots.txt file
«
on:
February 28, 2008, 10:40:15 PM »
Can anyone help me? Is there a robots.txt file generator I can use? I hear this helps with your sitemap file...?
Logged
XML-Sitemaps Support
11782
Re: robots.txt file
«
Reply #1 on:
February 28, 2008, 11:42:38 PM »
You can simply create text file in notepad, enter the following in it:
Code:
[Select]
Sitemap: http://www.yourdomain.com/sitemap.xml
save as "robots.txt" and upload into your domain root (I assume that you've already created and uploaded sitemap.xml).
Logged
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message
SEM and SEO Reports, more than 45M domains
: The world's leading Competitive Intelligence Tool for digital marketing.
tjholzk
4
Re: robots.txt file
«
Reply #2 on:
March 16, 2008, 06:53:23 PM »
Hello. I use a tool called Robot-Manager. You can read more about it and buy a copy at the following website:
[ External links are visible to forum administrators only ]
Good luck!
Logged
Sylwia
Re: robots.txt file
«
Reply #3 on:
April 19, 2008, 11:27:11 PM »
yahoo also read sitemap path from robots.txt??
Logged
XML-Sitemaps Support
11782
Re: robots.txt file
«
Reply #4 on:
April 20, 2008, 11:03:19 AM »
Yes.
Logged
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message
SEM and SEO Reports, more than 45M domains
: The world's leading Competitive Intelligence Tool for digital marketing.
Pages:
1
« previous
next »