Crawling only one folder
« on: April 11, 2016, 03:50:09 PM »
Hi.

Despite tweaking the configuration, I can't get the generator to crawl more than one folder. I've added "additional urls",  "include only" urls, https versions, - nothing works.

Any suggestions?

John Grenham
Re: Crawling only one folder
« Reply #1 on: April 11, 2016, 05:08:29 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
Re: Crawling only one folder
« Reply #2 on: April 12, 2016, 05:13:12 PM »
Did you get my private message?
Re: Crawling only one folder
« Reply #3 on: April 13, 2016, 05:18:59 AM »
I've changed Starting URL from [ External links are visible to logged in users only ] to [ External links are visible to logged in users only ] and it works now.
Re: Crawling only one folder
« Reply #4 on: April 16, 2016, 12:15:13 PM »
Nope.

Message at the "Crawling" tab: "Continue the interrupted session
Updated on 2016-04-16 11:07:08 (353 seconds ago) , Time elapsed: 0:25:05,
Pages crawled: 7460 (5434 added in sitemap), Queued: 198, Depth level: 4
Current page: browse/retrieve_text.php?text_contentid=138 (0.0)"

But when I tick the box and click "Run", I just get the same single-folder sitemap
Re: Crawling only one folder
« Reply #5 on: April 17, 2016, 06:02:09 AM »
The process has not been completed yet:
Sitemap details
Created on:
11 April 2016, 14:49


New sitemap is created only after the crawling is finished.