How to Exclude Wordpress when crawling subdirectory?
« on: February 01, 2010, 07:36:19 PM »
Hey there,

I am trying to figure how to exclude wordpress from the crawling process.  I am installing a Scuttle Bookmarking site in a subdirectory and I want to use the sitemap generator only for it.

My domain looks like this:

I use a wordpress plugin for its sitemaps, so I only want my Scuttle Bookmarks site to be crawled by the Sitemap Generator.

How can I exclude all the stuff in the root of the domain from crawled and only crawl that subdomain?

Thank you in advance.
Re: How to Exclude Wordpress when crawling subdirectory?
« Reply #1 on: February 02, 2010, 03:01:24 AM »

you can simply define Starting URL as:

and URLs formdomain root will not be included in sitemap.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.