Stand Alone Sitemap not Completing.
« on: February 04, 2007, 12:38:51 PM »
Hi,
My last sitemap was generated on 2007-01-27. Since then this is all I can get out of it.

Links depth: 3
Current page: lxx-kjv/Ambacum/index.htm
Pages added to sitemap: 298
Pages scanned: 2620 (22,323.9 Kb)
Pages left: 30 (+ 1016 queued for the next depth level)
Time passed: 0:51
Time left: 0:00
Memory usage: 1,354.5 Kb

There are a total of 1291 linked pages on my web site. Any configuration changes I make don’t seem to matter.
[ External links are visible to forum administrators only ]
Thanks for any help,
Ernie
Re: Stand Alone Sitemap not Completing.
« Reply #1 on: February 06, 2007, 12:02:36 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Re: Stand Alone Sitemap not Completing.
« Reply #2 on: February 08, 2007, 06:43:35 PM »
what is a good and usefully max_execution_time setting for a site with 60.000 pages ?

addon info: site is a bit slow
Re: Stand Alone Sitemap not Completing.
« Reply #3 on: February 09, 2007, 12:30:26 AM »
Hello,

basically, that depends on page generation time. For instance, in case if average page load time is 1 second (html part only, without images etc), total time would be at least 60,000 seconds for you.
Also, for larger sites we suggest to execute generator from command line if you have ssh access.
Re: Stand Alone Sitemap not Completing.
« Reply #4 on: February 10, 2007, 10:26:37 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

Now it works, must of been something whack at the hosting service. Didn't change anything (php.ini) as I don't know where to find it. But all is ok now, for some reason.
Thanks very much, Ernie
Re: Stand Alone Sitemap not Completing.
« Reply #6 on: February 14, 2007, 10:46:02 AM »
Could give us the SSH command to use to launch the script directly from the server?

I try one, but this error message came:

Warning: fclose(): supplied argument is not a valid stream resource in .../pages/class.utils.inc.php(2) : eval()'d code on line 17
3480 | 3471 | 90,621.1 | 6:38 | 6:37 | 4 | - | 3480 | 4742 | 0
« Last Edit: February 14, 2007, 11:12:08 AM by pduhaut »
Re: Stand Alone Sitemap not Completing.
« Reply #7 on: February 15, 2007, 02:35:45 PM »
Hello,

command line is:
/usr/local/bin/php /path/to/generator/runcrawl.php


make sure that you have set permissions correctly (0777 for data/ folder and 0666 for all files inside data/ folder).