• Welcome to Sitemap Generator Forum.
 

Resource Hog

Started by chris44, August 01, 2008, 08:45:31 PM

Previous topic - Next topic

chris44

Boy, if I knew that this program was such a resource hog...

Maybe if you had a function to turn off the queue, you would save on memory usage. I am on a shared server and cannot get over 1100 links in my SiteMap.

I can't imagine the load it would take if I spidered all 500,000 of my URLs  ???


XML-Sitemaps Support

Hello,

if you experience the increased server load due to intensive crawling of the site, it is recommended to use "Make delay after each X request" option that will let generator slow down the crawling process.