I keep getting internal server error message when crawling. It would index the pages for several minutes just fine, then the error pops up. it says that due to misconfiguration.
I've tried to reinstall it several times with the same result. and I believe, I've properly set the permissions for each files and folder. Pls help
url is [external links are visible to admins only]