west

*
  • *
  • 11
When is the sitemap.xml being created?
« on: August 09, 2019, 10:22:28 AM »
Hello,

I am currently creating a sitemap. In the interface it says this:

Links depth: 3
Current page: item/?pid=1003004011698286
Pages added to sitemap: 22555
Pages scanned: 22600 (805,395.0 KB)
Pages left: 186607 (+ 51382 queued for the next depth level)
Time passed: 4:33:30
Time left: 37:38:16
Memory usage: 171,191.5 Kb

But when I look at the sitemap.xml or ror.xml I see both are still size 0. Is this normal?

An other question is why does it take 4,5 hours to process 22k pages. Look very slow to me. Can it be my settings need to be optimised?

Suggestions are welcome.
« Last Edit: August 09, 2019, 11:11:42 AM by west »
Re: When is the sitemap.xml being created?
« Reply #1 on: August 09, 2019, 01:14:19 PM »
Hello,

sitemap is created after the crawling is finished.

The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

west

*
  • *
  • 11
Re: When is the sitemap.xml being created?
« Reply #2 on: August 09, 2019, 02:00:31 PM »
Thank you for the info.