XML Sitemaps Generator

Author Topic: Fatal error: Allowed memory size exhausted  (Read 14318 times)

McPhil

  • Registered Customer
  • Approved member
  • *
  • Posts: 8
Fatal error: Allowed memory size exhausted
« on: March 15, 2009, 08:34:27 PM »
Hi all - I've spent a very long time combing these forums and tweaking settings.  Here's what I've done:

1. data directory CHMOD 777
2. deleted all existing files in the data directory
3. ran stand alone generator.
4. all files in data directory CHMOD 666
5. ran generator again.
6. checked all data files for CHMOD 666

Server specs are great - quad-core xeons, 8GB memory, raid1 scsi boot, raid5 scsi data, apache 2.2, php 5.2.x , mysql 5.0.x, etc...

The generator runs for 18 minutes and then is crashes and dispatches an email with this at the bottom of the email:

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 71 bytes) in /home/user/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 182

Looking in the apache error logs we have this:

[Sun 15 Mar 15:30:35 2009] [error] [client] PHP Warning:  fclose(): supplied argument is not a valid stream resource in /home/user/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 34, referer: [external links are visible to admins only]
[Sun 15 Mar 15:30:35 2009] [error] [client] PHP Warning:  fwrite(): supplied argument is not a valid stream resource in /home/user/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 33, referer: [external links are visible to admins only]
[Sun 15 Mar 15:30:35 2009] [error] [client] PHP Warning:  fopen(/home/user/public_html/generator/data/crawl_dump.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in /home/user/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 32, referer: [external links are visible to admins only]

Does anyone have a clue why this generator just won't stay running?  Thanks.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Fatal error: Allowed memory size exhausted
« Reply #1 on: March 15, 2009, 10:49:04 PM »
Hello,

in order to address exceeding memory error, you should increase "memory_limit" setting in PHP configuration (php.ini). This is not related to the amount of real memory on server. Then create phpinfo.php file in generator folder with:
Code: [Select]
<?php
phpinfo
();
?>
and open it in browser to make sure that memory_limit was changed correctly.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

McPhil

  • Registered Customer
  • Approved member
  • *
  • Posts: 8
Re: Fatal error: Allowed memory size exhausted
« Reply #2 on: March 22, 2009, 08:11:10 PM »
What is the recommend setting?  We have about 200,000 pages on the website.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Fatal error: Allowed memory size exhausted
« Reply #3 on: March 23, 2009, 01:33:34 PM »
Hello,

exact setting depends also on site structure, URLs type, page titles length and other factors.
Please try to set it to 128M or 256M.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2