XML Sitemaps Generator

Author Topic: Resource Hog  (Read 20653 times)

chris44

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Resource Hog
« on: August 01, 2008, 08:45:31 PM »
Boy, if I knew that this program was such a resource hog...

Maybe if you had a function to turn off the queue, you would save on memory usage. I am on a shared server and cannot get over 1100 links in my SiteMap.

I can't imagine the load it would take if I spidered all 500,000 of my URLs  ???

« Last Edit: August 01, 2008, 08:53:36 PM by chris44 »

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10824
Re: Resource Hog
« Reply #1 on: August 02, 2008, 05:05:49 PM »
Hello,

if you experience the increased server load due to intensive crawling of the site, it is recommended to use "Make delay after each X request" option that will let generator slow down the crawling process.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.14 | SMF © 2017, Simple Machines
XHTML RSS WAP2