Sitemap Generator pauses for a long time
« on: September 19, 2011, 09:23:09 PM »
My first post, so please pardon my naiveté.

I'm running xml-sitemap Generator on my site and it pauses for long periods of time, wakes up and does a second or two of crawling and then pauses again. I have close to 300,000 pages.
Here's the most recent output:

Links depth: 4
Current page: BirdFinder/Month/July/AK_L1008142.pfg
Pages added to sitemap: 3619
Pages scanned: 13120 (3,859,853.2 KB)
Pages left: 273835 (+ 7 queued for the next depth level)
Time passed: 0:09:31
Time left: 3:18:46
Memory usage: 139,852.6 Kb
Auto-restart monitoring: Mon Sep 19 2011 13:21:16 GMT-0700 (PDT) (100 second(s) since last update) Resuming the last session (last updated: 2011-09-19 19:54:35)

Should I just let this run? It would go a lot faster if it didn't keep pausing. The server is my own vps running CentOS v5.5 and php v5.2.16.

Thanks for your help,

Nigel
Re: Sitemap Generator pauses for a long time
« Reply #1 on: September 20, 2011, 03:40:52 PM »
Ran this overnight and it didn't make much progress:

Links depth: 4
Current page: BirdFinder/Month/September/AK_L782177.pfg
Pages added to sitemap: 3619
Pages scanned: 13200 (3,859,853.2 KB)
Pages left: 273755 (+ 7 queued for the next depth level)
Time passed: 0:09:31
Time left: 3:17:31
Memory usage: 139,849.5 Kb
Auto-restart monitoring: Tue Sep 20 2011 07:39:37 GMT-0700 (PDT) (12 second(s) since last update) Resuming the last session (last updated: 2011-09-19 19:54:35)

Anyone got any ideas about how to get this thing to run?

Nigel
Re: Sitemap Generator pauses for a long time
« Reply #2 on: September 21, 2011, 10:40:30 AM »
Hello,

please let me know your generator URL/login in private message to check this.