Our sitemap typically generates about 24,000-25,000 pages. On our last run it generated over 27,000 pages so I examined it and found that many items are being listed in the html sitemap at least two times.
Is this necessary? Can it be prevented to decrease the size of the sitemap?
We often do updates or add /modify products while the sitemap is generating since it takes many hours and several restarts to complete. Could this be a problem?
We are using version Standalone Sitemap Generator (PHP) v5.0, 2011-01-25.
Thanks for your help!