Sitemap generator takes up lots of memory

[aberry]

Hi, I'm running the standalone sitemap generator under the Windows environment, here is my settings:
OS: Windows XP Prof. sp2
Webserver: Apache 2.2
PHP: php 5

The sitemap generator has been running for more than 1700 minutes already and it keeps going. The httpd.exe (I assume this is the process for php/apache?) is taking up 100MB of memory now and is growing at a steady pace, I'm wondering if this is normal and if the generator continue to run for another few days, will my computer eventually run out of memory??

Another side question is, is it normal for the generator to crawl about 88 pages per minute? My generator has crawled 150,000+ pages in 1700 minutes, wondering if that's normal speed...

Thanks

eddie

[admin]

Hello eddie,

yes, sitemap generator may require significant amount of memory for large sites. It is suggested to run it with cron job via command line in this case (as described in documentation).
The speed of crawling depends mainly on how fast works your website since http query is performed for every page. This is covered in the FAQ entry: http://www.xml-sitemaps.com/forum/index.php/topic,95.0.html