Hi all, had you guys install this on my site last week. Been trying to get it to work with no joy, I have looked through other threads and dont have ssh and probably will not be able to increase memory.

Links depth: 5
Current page: content/view/220/59/
Pages added to sitemap: 11349
Pages scanned: 16220 (587,380.3 Kb)
Pages left: 74 (+ 12185 queued for the next depth level)
Time passed: 77:50
Time left: 0:21
Memory usage: 16,224.3 Kb
Resuming the last session (last updated: 2008-05-04 22:19:58)
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 5583739 bytes) in /home/stacey19/public_html/generator/pages/class.utils.inc.php on line 6

Please help :)
Re: Fatal error: Allowed memory size of 33554432 bytes exhausted
« Reply #1 on: May 04, 2008, 11:41:30 PM »
Hello,

looks like you've added a lot of new content on your site now, much more pages are found by sitemap generator.
I've optimized your crawler settings and it should work fine now.
Re: Fatal error: Allowed memory size of 33554432 bytes exhausted
« Reply #2 on: May 04, 2008, 11:46:10 PM »
Thank you  :D

Just to clarify I need to run the crawler again then resubmit it to Google?

Yes we imported our users and threads from our other site, 2000+ members and nearly 20000 posts, i didnt realise that would make a difference, what a noob i am :p
« Last Edit: May 04, 2008, 11:48:57 PM by u360junkies »
Re: Fatal error: Allowed memory size of 33554432 bytes exhausted
« Reply #4 on: May 04, 2008, 11:58:23 PM »
Ok, doing now. Thanks again for the fast help :)
Re: Fatal error: Allowed memory size of 33554432 bytes exhausted
« Reply #5 on: May 14, 2008, 05:21:11 PM »
Hi

I made a post a week or so ago regarding this is in the title. You managed to fix it and it seemed to be working ok, however I ran it today again and it has started doing it once again.
One thing that i find strange is that it is going crazy on the links depth, page 86 when it fails, it says it is also on this page
forums/index.php/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/awards.php

Any assistance or advice would be greatly appreciated.
Re: Fatal error: Allowed memory size of 33554432 bytes exhausted
« Reply #6 on: May 14, 2008, 11:12:13 PM »
Looks like you have an endless loop of links in this case, try to add this in "Do not parse" and "Exclude URLs" options:
Code: [Select]
archive/archive
Re: Fatal error: Allowed memory size of 33554432 bytes exhausted
« Reply #7 on: May 15, 2008, 12:25:05 PM »
Thank you, that seems to have worked :)