Internal server error
« on: June 16, 2008, 11:05:29 AM »

This appears to be a common issue.

When I run the crawl I get to approx 1100 files added to sitemap when it stalls, and eventually I get this message: The actual file and directory where it stops varies.

I've tried increasing execution time, unselecting html sitemap and excluding more folders.

Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator, and inform them of the time the error occurred, and anything you might have done that may have caused the error.

More information about this error may be available in the server error log.

Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.

Many thanks

Re: Internal server error
« Reply #1 on: June 16, 2008, 05:32:42 PM »
Please try to enable "Run in background" option when executing sitemap generator.
Re: Internal server error
« Reply #2 on: June 16, 2008, 09:06:16 PM »

I've done this but I can't see anything. When I closed the window and then came back (several hours later) I just get the standard screen as if it wasn't crawling at all. I've tried this twice. Shouldn't I be able to see the progress? What should I do?
Run in background
 Do not interrupt the script even after closing the browser window until the crawling is complete
Resume last session
 Continue the interrupted session (2008-06-16 19:35:00, URLs added: 1176, estimated URLs left: 2160)
Click button below to start crawl manually

Many thanks

Re: Internal server error
« Reply #3 on: June 17, 2008, 10:16:50 PM »
What is the memory limit value you have set? Please PM me your generator URL.