Too Long To Generate Sitemaps
« on: February 12, 2009, 04:11:17 AM »
Really, it takes a very longtime to generate XML sitemap for google using your standalone version.

We have been generating our sitemap for 1 month now, and still we have not even reach up to 40% of our site.

What can we do to quicken our sitemap generation?

The current generating status (since last 1 month)
Pages added to sitemap: 50046
Pages scanned: 53980 (679,469.8 KB)
Pages left: 35492 (+ 63094 queued for the next depth level)
Time passed: 26213:20
Time left: 17235:20
Memory usage: 68,833.2 Kb

We have over 350,000 pages to generate (we also have a lot of deep links too), if we continue with this it can take us upto 3 months or more to generate all that.

Please help us solve this issue. Any idea on what we can do to generate XML sitemap faster can help.
Re: Too Long To Generate Sitemaps
« Reply #1 on: February 12, 2009, 10:12:36 PM »

in most cases this issue is resolved with a custom setup of "Do not parse"/"Exclude URLs"/"Memory limit" and other settings (depending on the sites).
Please PM me your generator URL/login to check that further.
Re: Too Long To Generate Sitemaps
« Reply #2 on: May 19, 2017, 02:53:53 AM »
I am getting 130000 pages in 23 minus. Used to having 130000 pages in days.
Hint was in Narrow Indexed Pages Set. Try Exclusion preset. I am now using this software without a hassle.