one more fatal error, memory limit post

[me3]

I just installed this sitemap generator, and am having major problems with it.  I am getting the same memory limit error as a lot of other people, and tried all of the posted fixes.  As this is on a dedicated box I was able to set the memory limit up to 500 megs.  It still failed.  I am very concerned about running any program that requires that much memory on my box.  Why doesn't it periodically write the memory to cache files before it fails?

[admin]

Why doesn't it periodically write the memory to cache files before it fails?

Hello,

you can use "Save state" option for that.

[me3]

this is for a realty site where we want to index all of the properties, so there are a lot of pages.

Links depth: 1
Current page: useful_stuff/resource/Massachusetts_North_Shore_Real_Estate.html
Pages added to sitemap: 40
Pages scanned: 40 (12,752.1 Kb)
Pages left: 253 (+ 107302 queued for the next depth level)
Time passed: 0:15
Time left: 1:36
Memory usage: 31,787.3 Kb

Fatal error: Allowed memory size of 524288000 bytes exhausted (tried to allocate 2358141 bytes) in /home/windhill/public_html/sitemap/pages/class.grab.inc.php(2) : eval()'d code on line 298

are the details.  I set the save state to 5 seconds, and it is still crashing.

[admin]

Saving the state every 5 seconds is way too often. You should set it to a few minutes (90-300 seconds).
Also, for larger sites it is recommended to execute it from the command line (via SSH access).

[me3]

if i do run it from the command line will i still have the memory errors?

[admin]

Usually the scripts executed from command line use different php configuration comparing to web scripts, so your memory limit may be higher (or no limit at all).