I have my sitemap generator running on [external links are visible to admins only]
I include links to the sitemaps in my footer.
My site is dynamic and pages are added and removed every night around 00:00 - 01:00.
Cron is set to run at 02:00
The generator is crawling the sitemap links and adding pages to the sitemap that have been removed that day. So my sitemap is growing constantly and includes pages that have been deleted.
Is there a fix for this? Can I exclude it crawling the current sitemap files/links?