Sitemap Using Previous embedded links
« on: August 07, 2011, 01:43:52 AM »
Hi There,

I have my sitemap generator running on

I include links to the sitemaps in my footer.

My site is dynamic and pages are added and removed every night around 00:00 - 01:00.

Cron is set to run at 02:00

The generator is crawling the sitemap links and adding pages to the sitemap that have been removed that day. So my sitemap is growing constantly and includes pages that have been deleted.

Is there a fix for this? Can I exclude it crawling the current sitemap files/links?

Re: Sitemap Using Previous embedded links
« Reply #1 on: August 07, 2011, 01:40:28 PM »

you should put "sitemap_build/" in "Do not parse" setting so that generator doesn't crawl old sitemap (that contains links to old pages)
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.