Way to not update?
« on: May 14, 2012, 08:23:43 PM »
The sitemap generator has been running well most of the time with approximately 3000+ URLs.  However, occasionally it runs and the number of URLs mapped is significantly different, ie: it can be anywhere from 15 to 1500.  Is there a way to keep the sitemap from writing to the file if the number of URLs mapped varies within a certain percentage of a stated number?  IE:  Do not update if the number of URLs is more than 10% less than 3200.


Gayla Recktenwald
Re: Way to not update?
« Reply #1 on: May 17, 2012, 10:07:43 AM »

there is no such an option.

Possibly your server blocks requests from generator bot in case if they are created at a fast rate. You can try using "Make delay for X seconds" option to slow down the crawling.