Homepage counted twice in xml and txt sitemaps
« on: May 18, 2009, 07:17:52 PM »
Hello,
i have had this problem before and you were able to fix it but it seems to be back again. i always get two homepages in each sitemap i create. i have read simmilar posts here and tried to include a backslash and /index.html to my homepage's url but they did not work. could you please help me? my website is [ External links are visible to forum administrators only ]
thank you!
Re: Homepage counted twice in xml and txt sitemaps
« Reply #1 on: May 19, 2009, 01:36:46 AM »
Hello,

you can try to exclude index.html with robots.txt file:
Code: [Select]
User-agent: *
Disallow: /index.html
Re: Homepage counted twice in xml and txt sitemaps
« Reply #2 on: May 19, 2009, 06:59:45 PM »
thak you it works now. can i leave "Disallow: /index.html" command in my robots.txt permanently or should i only use it when i am building a sitemap? i am using a redirect through my .htaccess file to avoid having two homepages. please let me know whether to use it permanently. thanks
Re: Homepage counted twice in xml and txt sitemaps
« Reply #3 on: May 19, 2009, 10:53:30 PM »
Hello,

yes, you can leave it since "index.html" just duplicates your main domain root homepage.