• Welcome to Sitemap Generator Forum.
 

Crawler reading Calandar links

Started by ajgilbertson, May 01, 2016, 06:45:03 PM

Previous topic - Next topic

ajgilbertson

How do I go about stopping the crawling of calendar years that are not even here yet?
Example 2020, 2022. I am showing a link depth of 91 currently "Current page: calendar/2023/09/21/"


ajgilbertson

Thanks -
I will give this a try.
The way it is going I may want to exclude the whole Calendar. Crawling the year 1923 now.