• Welcome to Sitemap Generator Forum.
 

script is to slow

Started by Neil29, July 06, 2022, 02:00:31 AM

Previous topic - Next topic

Neil29

i have a lot of urls to scan is their a way to make the script use more resources shush as CPU RAM

XML-Sitemaps Support

Hello,
The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.

poovendanv

Is any method or setting can be make it faster for sitemap generator? because i have more then 3.5Lakhs URL in my website

XML-Sitemaps Support

Hello,


The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.