Do not parse URLs
« on: October 18, 2006, 07:03:49 PM »
I have a page called search.asp. Now this page takes a lot of different substrings like pid=, countryid=, city=, p=, state= and these substrings can also be passed thruout the site. I dont want to crawl any pages that have any substrings, is this doable by settings a variable in the config section of the Standalone Version 2.4? If so can some give me a example of what i would need to put into the config area.

Thanks for the help in advance
Re: Do not parse URLs
« Reply #1 on: October 18, 2006, 11:56:50 PM »

sure, you should just add the following into both "Do not parse" and "Exclude URLs" options in sitemap generator configuration:
Code: [Select]