Is there a Skipped URL's max limit displayed in ChangeLog?
« on: April 24, 2017, 06:50:28 PM »
While the Sitemap Generator seems to be functioning as intended in so far as generating an accurate sitemap, I'm curious if there's a configuration setting to increase the number of Skipped URL's in the ChangeLog?

Not sure if I'm missing the location, or whether there's a hard limit of 1000 built into the application ... since this is the max value of Skipped URLs for all crawling instances when I know for certain there should be well over 3,000 Skipped URLs listed.

I am in the midst of a project to noindex "low quality, duplicate, and thin" content.  It would be helpful to have a complete list of Skipped URLs simply as a means of verification.

Any help or guidance is much appreciated.
« Last Edit: April 24, 2017, 06:53:37 PM by FaceOnMars »
Re: Is there a Skipped URL's max limit displayed in ChangeLog?
« Reply #1 on: April 25, 2017, 07:07:44 AM »
Hello,

yes, it's limited and you can change the limit by adding the setting in generator/data/generator.conf file:
<option name="xs_chlog_list_max">20000</option>
Re: Is there a Skipped URL's max limit displayed in ChangeLog?
« Reply #2 on: April 25, 2017, 04:08:14 PM »
Thank you!