sitemap.xml file is still empty after 40k+ pages crawled
« on: March 23, 2020, 04:06:27 PM »
Hi, i need help. This is my first time using this script for my website. My website has a lot of pages. The script has already crawled more than 40k pages now and it says 41949 added in sitemap but i still don't see anything on my sitemap.xml or ror.xml file. Please help.

Screenshot:
Re: sitemap.xml file is still empty after 40k+ pages crawled
« Reply #1 on: March 23, 2020, 05:46:35 PM »
Hello,

Sitemap is created only after the crawling is completed.
Re: sitemap.xml file is still empty after 40k+ pages crawled
« Reply #2 on: March 23, 2020, 05:58:37 PM »
Is that means i need to wait for it to crawl all pages of my website? That will take forever because my website is a youtube clone, it has billions of pages. Is there any way for it to create sitemap everytime it reach the limit of number of urls per sitemap file (in my case 40,000 per sitemap file)?
Re: sitemap.xml file is still empty after 40k+ pages crawled
« Reply #3 on: March 24, 2020, 04:22:57 PM »
Yes, this is correct. You can set "Maximum pages" limit to make smaller sitemap. Next time sitemap is created from the scratch though.
Re: sitemap.xml file is still empty after 40k+ pages crawled
« Reply #4 on: March 25, 2020, 09:44:13 AM »
Well thats not gonna work for my website i guess. Can i get a refund?