Does the '/' count in "do not parse?"
« on: October 03, 2010, 11:13:27 PM »
For example, I have categories on my site:


which I want the sitemap generator to parse because they contain links to individual job pages which are in:


When I tell it to not parse /job/, I think it sees that simply as 'job' because then it only crawls my home page.

Is there any way to escape the '/' to have the program treat it as part of the string so that it doesn't pick up /jobs/ as well?

Re: Does the '/' count in "do not parse?"
« Reply #1 on: October 04, 2010, 08:13:03 AM »

if you have "job/" in "Do not parse", then "jobs/" should be still parsed by geneerator bot.