Crashing Server
« on: April 19, 2008, 12:14:02 PM »
I have run this script on our server 4 times now and each time it brings the site down. I have tried everything including setting the pause to 120secs every 250 pages. Why is this happening??
Once the script finally finishes (after a reboot which costs us money as it is a dedicated server) it finds all of the 4500 pages, so I would have thought that this should not cause any problems.
Re: Crashing Server
« Reply #1 on: April 20, 2008, 11:13:34 AM »
I would suggest to try 1 sec delay after each 1 request instead to lower number of hits to the server.
Re: Crashing Server
« Reply #2 on: April 21, 2008, 12:06:58 AM »
Thanks, will try that.