Yet another out of memory issue
« on: October 24, 2008, 09:27:37 PM »
I have my PHP memory limit set to 500M.  Running it from the command line. Site is large.  After about 10 pages are processed I get this:

PHP Fatal error:  Out of memory (allocated 1587019776) (tried to allocate 23855078 bytes) in C:\inetpub\xxxx\generator\pages\class.utils.inc.php(2) : eval()'d code on line 6

What to do?
Re: Yet another out of memory issue
« Reply #1 on: October 25, 2008, 01:05:33 AM »
Hello,

do you mean that you have only 10 pages crawled at that point? Perhaps you have direct links to large files (videos/zips) on your site and sitemap generator tries to download them?
Re: Yet another out of memory issue
« Reply #2 on: October 25, 2008, 01:08:17 AM »
It looks that way, but honestly, I've run it many times and the output isn't easy to decipher.

My sitemap is set to exclude all the default types:
zip m4a m4v rar tar bz2 tgz exe gif jpg png class jar mpeg mpg mp3 wav mp4 avi wmv gz mov mid ra ram

Wouldnt that eliminate your scenario?
Re: Yet another out of memory issue
« Reply #3 on: October 25, 2008, 01:24:24 AM »
May be your links are pointing to a different file extension. Please PM me your generator URL/login to check that.
Re: Yet another out of memory issue
« Reply #4 on: October 28, 2008, 08:57:48 PM »
I sent you a PM -- can you check it out?