Sitemaps Generator includes noindex pages
« on: October 03, 2018, 06:12:49 AM »
Hi,

The standalone sitemap generator includes some pages which are set to "noindex, follow" into the sitemap. This causes errors in Google's Search Console.

How can this be fixed?

Thank you!
Re: Sitemaps Generator includes noindex pages
« Reply #1 on: October 03, 2018, 09:56:15 AM »
Hello,

could you please PM me your generator URL and an example noindex URL?
 
Re: Sitemaps Generator includes noindex pages
« Reply #2 on: October 03, 2018, 10:26:28 AM »
Thanks Oleg. I just sent you a PM.
Regards.
Re: Sitemaps Generator includes noindex pages
« Reply #3 on: October 03, 2018, 12:51:12 PM »
Please also provide login details for sitemap generator.
Re: Sitemaps Generator includes noindex pages
« Reply #4 on: October 03, 2018, 01:41:42 PM »
Just sent it now. Sorry.
Re: Sitemaps Generator includes noindex pages
« Reply #5 on: October 03, 2018, 03:28:35 PM »
Hello,

you have "Maximum depth level" setting set to "3". All pages from last depth level are not fetched from the server and are included directly in sitemap, hence "noindex" meta tag cannot be checked.
You would need to remove depth level limit to have all pages checked versus their robots meta tag.
Re: Sitemaps Generator includes noindex pages
« Reply #6 on: October 03, 2018, 03:39:09 PM »
Hello Oleg.

Thanks for the tip. I had that option set to 0 (unlimited) and, as I remember, the crawl didn't stop.
I will try it again and let you know how it behaves.

Regards.