XML Sitemaps Generator

Author Topic: Include only subdirectory without crawling root files and other directories.  (Read 3145 times)


  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
I have a subdirectory at:
[external links are visible to admins only]

starting URL: domain.com/subdirectory

I would like to set this up with only crawling this directory and not other subdirectories and root files.

Is this possible without adding the EACH of the files name and other subdirectories to "Exclude URLs:" plus having the subdirectory placed at ""Include ONLY" URLs:" as the subdirectoy.

A different way to look at this is having one sitemap in the root, and a seconded one has a sitemap generator too. Then having 2 sitemaps that don't crawl each other.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10916

if you specify Starting URL as domain.com/subdirectory/ (with ending slash), it would only include URLs in subdirectory/.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
sometimes it amazes me how a slash could make such a big difference.


mine was defaulting domain.com/sub

now domain.com/sub/ is working


SMF 2.0.14 | SMF © 2017, Simple Machines