How to stop crawling
« on: August 02, 2012, 03:22:51 AM »
We need to stop the crawling process, please advise how to do it.

We have a site with 000s of labels attached to the site pages. Apparently the crawler is visiting on each labels and this is bringing the site to its knees. We can't make it stop.

We are running Linux Ubuntu.

Thank you.
Re: How to stop crawling
« Reply #1 on: August 02, 2012, 10:13:01 PM »
Hello,

please try to create an empty file via ftp named "interrupt.log" in generator/data/ folder.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.