XML Sitemaps Generator

Author Topic: Sitemap generator takes up lots of memory  (Read 26730 times)


  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Sitemap generator takes up lots of memory
« on: June 16, 2006, 06:30:40 PM »
Hi, I'm running the standalone sitemap generator under the Windows environment, here is my settings:
OS: Windows XP Prof. sp2
Webserver: Apache 2.2
PHP: php 5

The sitemap generator has been running for more than 1700 minutes already and it keeps going. The httpd.exe (I assume this is the process for php/apache?) is taking up 100MB of memory now and is growing at a steady pace, I'm wondering if this is normal and if the generator continue to run for another few days, will my computer eventually run out of memory??

Another side question is, is it normal for the generator to crawl about 88 pages per minute? My generator has crawled 150,000+ pages in 1700 minutes, wondering if that's normal speed...



XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10599
Re: Sitemap generator takes up lots of memory
« Reply #1 on: June 17, 2006, 08:59:24 PM »
Hello eddie,

yes, sitemap generator may require significant amount of memory for large sites. It is suggested to run it with cron job via command line in this case (as described in documentation).
The speed of crawling depends mainly on how fast works your website since http query is performed for every page. This is covered in the FAQ entry: http://www.xml-sitemaps.com/forum/index.php/topic,95.html
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


SMF 2.0.12 | SMF © 2014, Simple Machines