I just finished crawling my forum a few times, using differant exclusions. My question is, is it better to include as much as possible, or I should I exclude all but the most relevant topics. Like most forums, I have an anything goes section, that sees a majority of the posting. The topics are not relevant to my site content, so I excluded those topics. After doing this, I went from over 600 pages indexed, down to 44. I imagine a bigger footprint in Google will get better traffic?
[external links are visible to admins only]
runs on SMF