XML Sitemaps Generator

Author Topic: Crawling only one folder  (Read 3098 times)

john.grenham

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Crawling only one folder
« on: April 11, 2016, 02:50:09 PM »
Hi.

Despite tweaking the configuration, I can't get the generator to crawl more than one folder. I've added "additional urls",  "include only" urls, https versions, - nothing works.

Any suggestions?

John Grenham

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Crawling only one folder
« Reply #1 on: April 11, 2016, 04:08:29 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

john.grenham

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: Crawling only one folder
« Reply #2 on: April 12, 2016, 04:13:12 PM »
Did you get my private message?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Crawling only one folder
« Reply #3 on: April 13, 2016, 04:18:59 AM »
I've changed Starting URL from http://www.yourdomain.com to https://www.yourdomain.com and it works now.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

john.grenham

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: Crawling only one folder
« Reply #4 on: April 16, 2016, 11:15:13 AM »
Nope.

Message at the "Crawling" tab: "Continue the interrupted session
Updated on 2016-04-16 11:07:08 (353 seconds ago) , Time elapsed: 0:25:05,
Pages crawled: 7460 (5434 added in sitemap), Queued: 198, Depth level: 4
Current page: browse/retrieve_text.php?text_contentid=138 (0.0)"

But when I tick the box and click "Run", I just get the same single-folder sitemap

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Crawling only one folder
« Reply #5 on: April 17, 2016, 05:02:09 AM »
The process has not been completed yet:
Sitemap details
Created on:
11 April 2016, 14:49


New sitemap is created only after the crawling is finished.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2