Sitemap stops after page X
« on: January 30, 2009, 10:11:42 PM »
My script is stopping after it says it adds 469 pages to the sitemap.

I've been watching execution time and memory. Maximum execution time is ignored by the script but has not been a problem in the past as the script has run for hours.

I tried excluding things to see if memory was an issue. Regardless of the amount of memory used, it stops on the 469th page.

I tried deleting the page it was getting hung on, and it still gets hung after 469 pages have been "added" to the sitemap.

Any ideas?







Re: Sitemap stops after page X
« Reply #2 on: January 31, 2009, 12:51:29 AM »
Thank you kind sir.

I noticed my xmlsitemap generator did not have an interrupt button like I read about in many posts so I downloaded and installed the newest version. I still don't see an interrupt button but this install seems to be working.

(I noticed that my host blanket chmoded many of my write-to map files to 644. grrr. They must have been having some sort of problem)

This has been a trusty app and the support is better than any other web based scripts I've bought.

Anyways, so far so good.

Links depth: 4
Current page: index.php?cPath=1_12_155&page=1&sort=2d
Pages added to sitemap: 1342
Pages scanned: 2020 (125,508.3 KB)
Pages left: 2999 (+ 3114 queued for the next depth level)
Time passed: 25:19
Time left: 37:36
Memory usage: 6,283.0 Kb
Re: Sitemap stops after page X
« Reply #3 on: January 31, 2009, 02:21:02 AM »
Same here...it stops after 40 pages.
Hangs up here:
Links depth: 1
Current page: content/view/224/429/
Pages added to sitemap: 37
Pages scanned: 40 (1,934.1 KB)
Pages left: 39 (+ 684 queued for the next depth level)
Time passed: 0:32
Time left: 0:31
Memory usage: -
Re: Sitemap stops after page X
« Reply #4 on: February 02, 2009, 01:17:37 AM »
crxvfr,

looks like you have an oscommerce based website, make sure to use these settings for better crawling performance: https://www.xml-sitemaps.com/forum/index.php/topic,1241.html


zuze,

you should increase max_execution_time and memory_limit settings in PHP configuration.