Here is the problem.
First of all I tried running it through webpage to complete the first run which was a failure with the below exception.
Links depth: 2
Current page: profile/SuzanneBr
Pages added to sitemap: 4733
Pages scanned: 4740 (122,741.7 KB)
Pages left: 7015 (+ 38128 queued for the next depth level)
Time passed: 15:05
Time left: 22:20
Memory usage: 20,005.8 Kb
Resuming the last session (last updated: 2009-03-11 10:43:16)
Fatal error: Out of memory (allocated 46137344) (tried to allocate 44 bytes) in /home/gailm/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6
Then as per the Admin's suggestion I tried running the cron command through SSH which was also a failure.
I contacted my Host, see the below reply.
I ran the generator in your jailshell account to see the error, and the script is indeed running up on the memory limit. There is a 64M limit for php processes. You will need to contact the developer of the script to see about reducing its memory consumption.
As a note, I ran the script with a raised memory limit and it seems to have worked, though I have no way of knowing for sure. It didn't produce a memory error.
php -d memory_limit=128M public_html/generator/runcrawl.php
If you use this command, please be aware that if you run it often (more than once every hour or so), you run the risk of having your account suspended for over-utilization of system resources.
Even when I tried to run the command by raising the Memory Limit to 128 was a failure.
See the below fatal error.
[20-Mar-2009 11:06:12] PHP Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 12877744 bytes) in /home/gailm/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6
[20-Mar-2009 11:07:20] PHP Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 12796362 bytes) in /home/gailm/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6
So, as of now my sitemap is not complete.
It would be great if someone solves my problem.
Thanks in advance,