Issues crawling our site

[kevin18]

We have a Xencart site, the system has around 70k active items but the sitemap generator only found around 58k pages I would expect it to find significantly more that that.

It also takes 14 hours+ to run the crawl, how do we speed that up?
-Kevin

[XML-Sitemaps Support]

Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

You can use "Exclude URLs"/ "Add directly in sitemap" settings to increase crawling speed.