Unlimited Sitemap Generator Won't Make it Through Crawl
« on: February 03, 2011, 08:22:58 PM »
Every time I attempt to crawl it locks up and spits back an error:

Internal Server Error

The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator, support@supportwebsite.com and inform them of the time the error occurred, and anything you might have done that may have caused the error.

More information about this error may be available in the server error log.


My site is about 35,000 pages.  Its taking forever, obviously, and I can't get through it.  I'm on a shared host.  I have changed the php.ini as well to max input time to 600
« Last Edit: February 03, 2011, 08:26:29 PM by propinthehub »
Re: Unlimited Sitemap Generator Won't Make it Through Crawl
« Reply #1 on: February 04, 2011, 02:34:07 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Re: Unlimited Sitemap Generator Won't Make it Through Crawl
« Reply #2 on: February 08, 2011, 05:53:02 PM »
I changed hosts to a VPS and it got through it but then it spit out the following:

Error writing to these files:
/generator/data/sitemap.html
/generator/data/sitemap2.html
/generator/data/sitemap3.html
/generator/data/sitemap4.html
/generator/data/sitemap5.html
/generator/data/sitemap6.html
/generator/data/sitemap7.html
/generator/data/sitemap8.html
/generator/data/sitemap9.html
/generator/data/sitemap10.html
/generator/data/sitemap11.html
/generator/data/sitemap12.html
/generator/data/sitemap13.h


All the files that the setup guide points out are 777 or 666. 
Re: Unlimited Sitemap Generator Won't Make it Through Crawl
« Reply #3 on: February 08, 2011, 07:09:10 PM »
Its not writing anything to my XML file either.
Re: Unlimited Sitemap Generator Won't Make it Through Crawl
« Reply #4 on: February 08, 2011, 08:31:45 PM »
Disregard this.  Posting in the unlimited section.
Re: Unlimited Sitemap Generator Won't Make it Through Crawl
« Reply #5 on: February 09, 2011, 01:24:33 PM »
Hello,

> Error writing to these files:

Are the files actually created? (i.e. can you see them via ftp)