How to create an exception for a whole level / category
« on: August 10, 2010, 11:20:55 AM »
I figured this issue warranted its on thread.

I wanted to create an exception so that the generator ignores/does not index a full level on the site.

I want to create the exception so that everything under and including the folder category1 is ignored.

furthermore, i would like to ignore all links that have the "nofollow" attribute on them.

How to do this?