XML Sitemaps Generator

Author Topic: How to make crawl slower?  (Read 10015 times)

tommixoft2

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
How to make crawl slower?
« on: July 31, 2009, 01:18:59 AM »
Hi..i want to make crawl process slower cause it very slows my site (takes trafic, requests and you know..).. do i have to use

Make a delay between requests, X seconds after each N requests: function? and how should i know how much requests it does?

thanks, your sitemap tool is the best.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: How to make crawl slower?
« Reply #1 on: July 31, 2009, 12:32:02 PM »
Exactly, this option is used to slow down the crawling process. One request is basically one URL added to your sitemap. You can try something like 1 second delay after each 10 or 20 requests and see how it works for you.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2