Sitemap Generator Forum

Hi all, had you guys install this on my site last week. Been trying to get it to work with no joy, I have looked through other threads and dont have ssh and probably will not be able to increase memory.

Links depth: 5
Current page: content/view/220/59/
Pages added to sitemap: 11349
Pages scanned: 16220 (587,380.3 Kb)
Pages left: 74 (+ 12185 queued for the next depth level)
Time passed: 77:50
Time left: 0:21
Memory usage: 16,224.3 Kb
Resuming the last session (last updated: 2008-05-04 22:19:58)
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 5583739 bytes) in /home/stacey19/public_html/generator/pages/class.utils.inc.php on line 6

Please help

Hello,

looks like you've added a lot of new content on your site now, much more pages are found by sitemap generator.
I've optimized your crawler settings and it should work fine now.

Thank you 

Just to clarify I need to run the crawler again then resubmit it to Google?

Yes we imported our users and threads from our other site, 2000+ members and nearly 20000 posts, i didnt realise that would make a difference, what a noob i am :p

Yes, please just regenerate sitemap and resubmit it.

Ok, doing now. Thanks again for the fast help

Hi

I made a post a week or so ago regarding this is in the title. You managed to fix it and it seemed to be working ok, however I ran it today again and it has started doing it once again.
One thing that i find strange is that it is going crazy on the links depth, page 86 when it fails, it says it is also on this page
forums/index.php/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/archive/awards.php

Any assistance or advice would be greatly appreciated.

Looks like you have an endless loop of links in this case, try to add this in "Do not parse" and "Exclude URLs" options:
archive/archive

Thank you, that seems to have worked