Fatal error: Allowed memory size exhausted
« on: March 15, 2009, 08:34:27 PM »
Hi all - I've spent a very long time combing these forums and tweaking settings.  Here's what I've done:

1. data directory CHMOD 777
2. deleted all existing files in the data directory
3. ran stand alone generator.
4. all files in data directory CHMOD 666
5. ran generator again.
6. checked all data files for CHMOD 666

Server specs are great - quad-core xeons, 8GB memory, raid1 scsi boot, raid5 scsi data, apache 2.2, php 5.2.x , mysql 5.0.x, etc...

The generator runs for 18 minutes and then is crashes and dispatches an email with this at the bottom of the email:

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 71 bytes) in /home/user/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 182

Looking in the apache error logs we have this:

[Sun 15 Mar 15:30:35 2009] [error] [client] PHP Warning:  fclose(): supplied argument is not a valid stream resource in /home/user/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 34, referer: [ External links are visible to forum administrators only ]
[Sun 15 Mar 15:30:35 2009] [error] [client] PHP Warning:  fwrite(): supplied argument is not a valid stream resource in /home/user/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 33, referer: [ External links are visible to forum administrators only ]
[Sun 15 Mar 15:30:35 2009] [error] [client] PHP Warning:  fopen(/home/user/public_html/generator/data/crawl_dump.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in /home/user/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 32, referer: [ External links are visible to forum administrators only ]

Does anyone have a clue why this generator just won't stay running?  Thanks.
Re: Fatal error: Allowed memory size exhausted
« Reply #1 on: March 15, 2009, 10:49:04 PM »
Hello,

in order to address exceeding memory error, you should increase "memory_limit" setting in PHP configuration (php.ini). This is not related to the amount of real memory on server. Then create phpinfo.php file in generator folder with:
Code: [Select]
<?php
phpinfo
();
?>
and open it in browser to make sure that memory_limit was changed correctly.
Re: Fatal error: Allowed memory size exhausted
« Reply #2 on: March 22, 2009, 08:11:10 PM »
What is the recommend setting?  We have about 200,000 pages on the website.
Re: Fatal error: Allowed memory size exhausted
« Reply #3 on: March 23, 2009, 01:33:34 PM »
Hello,

exact setting depends also on site structure, URLs type, page titles length and other factors.
Please try to set it to 128M or 256M.