Thanks for the reply. Actually I think that may have been the question I should have asked. In using the exclude, if I want to mimic the robots.txt as far as content, can I use folders in the exclude? When I set up the scipt, I did copy the contents of your suggested list, so now the question is can I just add folders to exclude like I do in the robots.txt file?
TIA for a reply.