Internal server error
« on: June 04, 2009, 05:07:02 PM »

My sitemap generator is at [ External links are visible to forum administrators only ]. This a +17K classifieds site and I am getting an 'Internal Server Error' message at about 3-5mins after starting the crawl (regardless if I check the 'run in the background' box. the sitemap crawling seems to stop at 154 pages and about 9-10MB.

I have excluded the duplicate content ( print/) and only included the html classifieds detail pages ( category/ ). I would like to include other pages available in the nav menu and the homepage also.

Thanks in advance for your help,

Re: Internal server error
« Reply #1 on: June 05, 2009, 03:07:25 AM »

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.