Generator doesn't crawl all the urls
« on: May 18, 2014, 01:43:29 AM »
The generator isn't crawling my entire site. My site has around 150k-200k pages, but it creates a sitemap after only 15k urls. What is the problem? It ran for around 19 hours.
Re: Generator doesn't crawl all the urls
« Reply #2 on: May 22, 2014, 09:06:18 PM »
Hello,

replied to your email.
Hi. The unlimited depth levels did not solve the issue. It stopped again. I sent you another email.