Stuck at 3000 pages?
« on: June 11, 2007, 11:45:16 AM »
We've been having some probelms with our sitemap generator in that it seems to get stuck at a limit of 3000 scanned pages. I have checked our settings and the maximum page limit is set to 0 (i.e. unlimited).

If I set this to 2900 then the script runs and completes correctly, but anything over 3000 will cause the script to get as far as 3000 pages and then hang there.

Any ideas anyone?

using version 2.5.2 (now updated to 2.5.3 to see if that makes any difference but I don't anticipate it)
Re: Stuck at 3000 pages?
« Reply #1 on: June 12, 2007, 01:16:41 AM »

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Re: Stuck at 3000 pages?
« Reply #2 on: July 24, 2007, 02:41:11 AM »
I have a similar problem. Is there any way to fix this without changing the php configs? Why can't I just keep on appending to the sitemap bit by bit?
Re: Stuck at 3000 pages?
« Reply #3 on: July 24, 2007, 10:10:37 PM »
Yes, you can also restart it multiple times with "resume generation" checkbox enabled until crawling is completed.