Internal Server Error + limited crawling
« on: March 29, 2008, 05:24:08 PM »
I keep getting the error
*************************
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator, webmaster@webefforts.co.uk and inform them of the time the error occurred, and anything you might have done that may have caused the error.

More information about this error may be available in the server error log.
****************************

I have found if i set crawling to 100 pages it works. But it struggles to do any more.I have my old xml sitemap up, but they are over 6mb still!

 I have tried to do more unlimited crawling and now i constantly get a 500 internal server error page??

Any ideas?

« Last Edit: March 29, 2008, 05:37:48 PM by order8 »
Re: Internal Server Error + limited crawling
« Reply #1 on: March 30, 2008, 09:23:24 PM »
Hello,

please PM me your generator URL and an eesitemated numbet of pages on your site so that I can check it.
Re: Internal Server Error + limited crawling
« Reply #2 on: March 31, 2008, 05:14:50 PM »
I have pm'd you.

Looks like this isn't going to work.,
Re: Internal Server Error + limited crawling
« Reply #3 on: April 01, 2008, 03:08:47 AM »
Hello,

I've optimized your crawler settings and sitemap has been created now:
Request date:
1 April 2008, 01:15
Processing time:
408.53s
Pages indexed:
2230