XML Sitemaps Generator

Author Topic: Fatal Error while crawling the pages  (Read 9945 times)

info1521

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Fatal Error while crawling the pages
« on: November 30, 2010, 08:01:50 PM »
I installed the script properly, when i start crawling then after scanning 5500+ pages I got the following error...

please suggest how can I fix this... if I required any change in the crawling settings...?

Fatal error: Out of memory (allocated 54263808) (tried to allocate 40216137 bytes) in /home/cgaqwers/public_html/sitemap/pages/class.http.inc.php(2) : eval()'d code on line 128

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Fatal Error while crawling the pages
« Reply #1 on: November 30, 2010, 09:37:00 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

info1521

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Re: Fatal Error while crawling the pages
« Reply #2 on: November 30, 2010, 09:44:04 PM »
Thanks for reply, can you tell me how much increase memory_limit and max_execution_time will be good for this script?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Fatal Error while crawling the pages
« Reply #3 on: December 01, 2010, 10:45:49 PM »
Hello,

that depends on the size of webste, try to increase it to 256M.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

info1521

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Re: Fatal Error while crawling the pages
« Reply #4 on: December 02, 2010, 09:09:41 AM »
that's already 756MB and execution time is 180sec

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Fatal Error while crawling the pages
« Reply #5 on: December 02, 2010, 04:18:10 PM »
Hello,

please let me know your generator URL/login in private message to check this.
From your message it seems that limit is lower:
>Fatal error: Out of memory (allocated 54263808) (tried to allocate 40216137 bytes)
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

info1521

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Re: Fatal Error while crawling the pages
« Reply #6 on: December 02, 2010, 07:20:37 PM »
When I start using crawling depth to 5 and "use temporary files to store crawling progress ", then i am not receiving any error.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2