Stop in the middle of crawling
« on: August 06, 2016, 03:17:35 PM »
My web site is located more than 10000 pages
sitemap.xml is not generated only 150 pages.

How you can crawl all the pages it?

My environment centos6.7 php5.6
Re: Stop in the middle of crawling
« Reply #1 on: August 06, 2016, 06:42:22 PM »

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?