Hello,
I suggest you to use "Make delay for X seconds after every Y request" option to insert pause in crawling process and reduce CPU load as a result.
Thanks Admin
This is THE most important setting IMO - each server's CPU can only handle so much and if you have a huge site with many pages to add to the sitemap,
PLEASE give your host a break and add the delay... you could cause a system crash or CERTAINLY slow processing down for all other users if you have a virtual server hosting account
I suggest limiting the usage to "Make delay for X seconds after every Y request" where X = 10 and Y = 10 or even X = 5 and Y = 5 - the server will thank you
OK, so it takes longer to crawl your site to add to the sitemap but causing high server load may be a violation of your hosts' TOS & AUP. If you're desperate to make a sitemap, make a coffee or go for a walk whilst it crawls otherwise (if no limitations are set in config.inc.php) you're causing the server load to go way over the top & memory usage is, obviously, high
Be gentle please? Your server host will thank you 