Page crawling issues - Assist me to rectify it ....
« on: December 11, 2018, 12:14:20 PM »
Hi

I am trying to generate XML sitemap for our website but the tool only crawl 2074 pages instead of whole available pages (more than 50k). I have checked it with multiple times but the same result is come.

It should be crawl whole site instead of 2074, what is wrong there, please let me know?

At the time of starting it was crawled whole site means all the pages around 38k but after that time it is crawling only 2074 pages.
Re: Page crawling issues - Assist me to rectify it ....
« Reply #1 on: December 11, 2018, 12:30:00 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?