• Welcome to Sitemap Generator Forum.
 

How to Limit Crawl To Specific URL String

Started by jhazlewood, October 11, 2006, 08:32:15 PM

Previous topic - Next topic

jhazlewood

How do I set the crawler to only crawl urls on my site that contain the following in the URL string: itemType=CATEGORY in the url string?

Currently the crawler is taking days to get through our site and if I can limit the sitemap to only crawl our extensive combination of categories it should bring the crawl to a more manageable crawl time.

Thanks,
Jason

XML-Sitemaps Support

Hello Jason,

currently there is no option for "Crawl only" URLs in sitemap generator, but you can use "Do not parse" option to exclude certain parts of your site.