XML Sitemaps Generator

Author Topic: Crawling freezes website - cannot acces site  (Read 9353 times)

wcb1

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Crawling freezes website - cannot acces site
« on: June 23, 2011, 04:18:44 PM »
Every time I run the crawler my site becomes completely inaccessible - I have tried various settings and I have tried setting the delay to 2s delay every 4 requests and still it freezes my site.

My server has plenty of RAM.

When the crawler runs - no pages on the website load - nothing!

wcb1

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Crawling freezes website - cannot acces site
« Reply #1 on: June 23, 2011, 05:01:52 PM »
well... i just installed the update to verison 5.0 and now it doesn't seem to freeze !! wahay!
But i will wait and see if this is a one off or not - because with version 4 it would sometimes not freeze up my site and sometiems it would.. seemingly random.

so i will post back here soon.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2