Generator getting stuck....
« on: January 06, 2014, 03:17:48 PM »
Quote
Links depth: 3
Current page: products/XXXX/XXXX/XXX.html?limit=15
Pages added to sitemap: 934
Pages scanned: 1305 (101,613.5 KB)
Pages left: 23975 (+ 67592 queued for the next depth level)
Time passed: 0:24:11
Time left: 7:24:30
Memory usage: 115,720.9 Kb


Hi all,

We have a site with around 25k links in total. The generator seems to get stuck at 1305, at the same point every time we've tried to run it.

A cron was set up for it to run at 11pm daily (last friday) we came in today to find that no sitemap was produced.

Any help or pointers would be fantastic, as this needs to be sorted asap due to draining time! :)

Many Thanks
Re: Generator getting stuck....
« Reply #1 on: January 07, 2014, 07:40:51 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
From the progress report though, it's not just 1305 pages indexed, but also found (stored): 23975 (+ 67592 queued for the next depth level)
Re: Generator getting stuck....
« Reply #2 on: January 07, 2014, 08:57:00 AM »
Spotted that before I saw your reply.

Got to it this morning and;

Quote
Quote
Continue the interrupted session
Updated on 2014-01-07 06:46:15, Time elapsed: 14:14:28,
Pages crawled: 126416 (4148 added in sitemap), Queued: 30121, Depth level: 4
Current page: products/XXXX.html?XXXX/XXX
Re: Generator getting stuck....
« Reply #3 on: January 09, 2014, 12:33:21 PM »
Hello,

please let me know your generator URL/login in private message to check this.