[Slow] Pages added to sitemap
« on: March 10, 2016, 05:07:36 AM »
Hello,

When I saw the online demo on xml-sitemaps.com the online standalone version speed was about 1500 pages per minute, but when I am running it on my site it is about 28 pages in 3 mins? Why?

Please help.
Re: [Slow] Pages added to sitemap
« Reply #1 on: March 11, 2016, 03:21:13 AM »
Hello,

The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

please let me know your generator URL/login in private message to check this.
Re: [Slow] Pages added to sitemap
« Reply #2 on: March 11, 2016, 03:35:38 AM »
Sent personal message.
Re: [Slow] Pages added to sitemap
« Reply #3 on: May 19, 2017, 02:57:04 AM »
I am getting 130000 pages in 23 minus. Used to having 130000 pages in days.
Hint was in Narrow Indexed Pages Set. Try Exclusion preset. I am now using this software without a hassle.