Duplicate URLs
« on: March 24, 2007, 04:45:08 AM »
My site has over a million pages.   Many of them have the same links on the bottom of the page.   When Sitemaps is done running , and makes new XML files, does it delete duplicate URLs that it spidered?

Thanks.
Re: Duplicate URLs
« Reply #1 on: March 25, 2007, 12:43:10 AM »
Hello,

every link is only included once in sitemap (no matter how many times it is linked on different pages).