Difficulty Creating A Sitemap...
« on: October 07, 2013, 03:00:29 AM »

Is it unusual for Sitemap Generator to take over 24 hours to generate a map? This is a recent development. Originally, the maps would generate in less than fifteen mins. Why would this be happening?

Re: Difficulty Creating A Sitemap...
« Reply #1 on: October 07, 2013, 02:35:32 PM »

The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.