XML Sitemaps Generator

Author Topic: Crawling only one folder  (Read 1779 times)

ewise

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Crawling only one folder
« on: January 31, 2017, 01:56:36 PM »
Hello.

How to crawl a folder? For example: [external links are visible to admins only]...

Thank you so much.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10811
Re: Crawling only one folder
« Reply #1 on: February 02, 2017, 06:26:09 AM »
Hello,

you need to specify http://www.domain.com/folder/only-this-folder/ as Starting URL.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ewise

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Crawling only one folder
« Reply #2 on: February 02, 2017, 12:10:08 PM »
Yes, I did it but crawling all site.

So I added the name of the folders I did not want in "Exclude URLs" and worked.

Thank you.

 

SMF 2.0.14 | SMF © 2017, Simple Machines
XHTML RSS WAP2