XML Sitemaps Generator

Author Topic: How to stop crawling  (Read 8285 times)


  • Registered Customer
  • Approved member
  • *
  • Posts: 1
How to stop crawling
« on: August 02, 2012, 02:22:51 AM »
We need to stop the crawling process, please advise how to do it.

We have a site with 000s of labels attached to the site pages. Apparently the crawler is visiting on each labels and this is bringing the site to its knees. We can't make it stop.

We are running Linux Ubuntu.

Thank you.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10599
Re: How to stop crawling
« Reply #1 on: August 02, 2012, 09:13:01 PM »

please try to create an empty file via ftp named "interrupt.log" in generator/data/ folder.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


SMF 2.0.12 | SMF © 2014, Simple Machines