XML Sitemaps Generator

Author Topic: How to stop crawling  (Read 8442 times)

jarrau

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
How to stop crawling
« on: August 02, 2012, 02:22:51 AM »
We need to stop the crawling process, please advise how to do it.

We have a site with 000s of labels attached to the site pages. Apparently the crawler is visiting on each labels and this is bringing the site to its knees. We can't make it stop.

We are running Linux Ubuntu.

Thank you.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: How to stop crawling
« Reply #1 on: August 02, 2012, 09:13:01 PM »
Hello,

please try to create an empty file via ftp named "interrupt.log" in generator/data/ folder.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2