I migrated to a new, faster server - 8 cores instead of 4  and 12GB RAM up from 4GB.  Crawls now are taking 6.5 hours, up from under 2 hours previously.  Page count remains the same.

What should I be looking for?
« Last Edit: September 17, 2010, 03:24:04 PM by jnmunsey »
Re: Migrating to new faster server and crawls now take four times as long
« Reply #2 on: October 03, 2010, 05:55:05 PM »
FYI the issue was related to my PHP caching app not running due to PHP running in CGI mode.  The caching apps require mod_php and do not run under CGO/Fast CGI as they run each PHP script in a separate process.

Once fixed the speed returned.