XML Sitemaps Generator

Author Topic: Migrating to new faster server and crawls now take four times as long  (Read 8918 times)

jnmunsey

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
I migrated to a new, faster server - 8 cores instead of 4  and 12GB RAM up from 4GB.  Crawls now are taking 6.5 hours, up from under 2 hours previously.  Page count remains the same.

What should I be looking for?
« Last Edit: September 17, 2010, 02:24:04 PM by jnmunsey »

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Migrating to new faster server and crawls now take four times as long
« Reply #1 on: September 18, 2010, 07:37:10 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

jnmunsey

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: Migrating to new faster server and crawls now take four times as long
« Reply #2 on: October 03, 2010, 04:55:05 PM »
FYI the issue was related to my PHP caching app not running due to PHP running in CGI mode.  The caching apps require mod_php and do not run under CGO/Fast CGI as they run each PHP script in a separate process.

Once fixed the speed returned.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Migrating to new faster server and crawls now take four times as long
« Reply #3 on: October 04, 2010, 07:10:24 AM »
Thank you for the follow-up!
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2