• Welcome to Sitemap Generator Forum.
 

Include only subdirectory without crawling root files and other directories.

Started by sm, February 01, 2017, 03:24:54 PM

Previous topic - Next topic

sm

I have a subdirectory at:
[ External links are visible to forum administrators only ]

domain.com/subdirectory
starting URL: [ External links are visible to forum administrators only ]

I would like to set this up with only crawling this directory and not other subdirectories and root files.

Is this possible without adding the EACH of the files name and other subdirectories to "Exclude URLs:" plus having the subdirectory placed at ""Include ONLY" URLs:" as the subdirectoy.

A different way to look at this is having one sitemap in the root, and a seconded one has a sitemap generator too. Then having 2 sitemaps that don't crawl each other.

XML-Sitemaps Support

Hello,

if you specify Starting URL as [ External links are visible to logged in users only ] (with ending slash), it would only include URLs in subdirectory/.

sm

sometimes it amazes me how a slash could make such a big difference.

Thanks!!

mine was defaulting [ External links are visible to forum administrators only ]

now [ External links are visible to forum administrators only ] is working