XML Sitemaps Generator

Author Topic: Include only subdirectory without crawling root files and other directories.  (Read 1171 times)

sm

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
I have a subdirectory at:
[external links are visible to admins only]

domain.com/subdirectory
starting URL: domain.com/subdirectory

I would like to set this up with only crawling this directory and not other subdirectories and root files.

Is this possible without adding the EACH of the files name and other subdirectories to "Exclude URLs:" plus having the subdirectory placed at ""Include ONLY" URLs:" as the subdirectoy.

A different way to look at this is having one sitemap in the root, and a seconded one has a sitemap generator too. Then having 2 sitemaps that don't crawl each other.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10764
Hello,

if you specify Starting URL as domain.com/subdirectory/ (with ending slash), it would only include URLs in subdirectory/.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

sm

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
sometimes it amazes me how a slash could make such a big difference.

Thanks!!

mine was defaulting domain.com/sub

now domain.com/sub/ is working

 

SMF 2.0.13 | SMF © 2014, Simple Machines
XHTML RSS WAP2