Took your advice and made a few changes and was working my way back up by increasing the number of pages. Just completed a craw for 5000 pages and now I get the "Internal Server Error" for any tab other than 'Documentation'. Check the other posting in the form and the next step seems to be providing you with the url - [external links are visible to admins only]
I was having a problem getting the process to write to the sitemap.html files. Was receiving an error that the process could not write to the files and I had just updated the premissions and was in the process of doing another craw to see if I had corrected the problem when I got the 'Internal Server Error'.
Is there a chance that my server is now blocking me?