• Welcome to Sitemap Generator Forum.
 

Sitemap Generator pauses for a long time

Started by nigel8, September 19, 2011, 09:23:09 PM

Previous topic - Next topic

nigel8

My first post, so please pardon my naiveté.

I'm running xml-sitemap Generator on my site and it pauses for long periods of time, wakes up and does a second or two of crawling and then pauses again. I have close to 300,000 pages.
Here's the most recent output:

Links depth: 4
Current page: BirdFinder/Month/July/AK_L1008142.pfg
Pages added to sitemap: 3619
Pages scanned: 13120 (3,859,853.2 KB)
Pages left: 273835 (+ 7 queued for the next depth level)
Time passed: 0:09:31
Time left: 3:18:46
Memory usage: 139,852.6 Kb
Auto-restart monitoring: Mon Sep 19 2011 13:21:16 GMT-0700 (PDT) (100 second(s) since last update) Resuming the last session (last updated: 2011-09-19 19:54:35)

Should I just let this run? It would go a lot faster if it didn't keep pausing. The server is my own vps running CentOS v5.5 and php v5.2.16.

Thanks for your help,

Nigel

nigel8

Ran this overnight and it didn't make much progress:

Links depth: 4
Current page: BirdFinder/Month/September/AK_L782177.pfg
Pages added to sitemap: 3619
Pages scanned: 13200 (3,859,853.2 KB)
Pages left: 273755 (+ 7 queued for the next depth level)
Time passed: 0:09:31
Time left: 3:17:31
Memory usage: 139,849.5 Kb
Auto-restart monitoring: Tue Sep 20 2011 07:39:37 GMT-0700 (PDT) (12 second(s) since last update) Resuming the last session (last updated: 2011-09-19 19:54:35)

Anyone got any ideas about how to get this thing to run?

Nigel