Not crawl links on pages with Meta noindex, follow
« on: May 26, 2015, 12:08:19 PM »
Hello,

The problem is in subject. This pages not crawl even if I put it into "Crawl, but do not include URLs:"

Thanx
Re: Not crawl links on pages with Meta noindex, follow
« Reply #1 on: May 27, 2015, 06:15:49 AM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?