• Welcome to Sitemap Generator Forum.
 

Migrating to new faster server and crawls now take four times as long

Started by jnmunsey, September 17, 2010, 03:17:27 PM

Previous topic - Next topic

jnmunsey

I migrated to a new, faster server - 8 cores instead of 4  and 12GB RAM up from 4GB.  Crawls now are taking 6.5 hours, up from under 2 hours previously.  Page count remains the same.

What should I be looking for?


jnmunsey

FYI the issue was related to my PHP caching app not running due to PHP running in CGI mode.  The caching apps require mod_php and do not run under CGO/Fast CGI as they run each PHP script in a separate process.

Once fixed the speed returned.