number of urls indexed suddenly decreased
« on: October 18, 2010, 09:35:22 PM »
Hi,
my generator has suddenly decreased the number of urls indexed, after a couple of days where the crawler didn't work with the chrono job, after the upgrade to version 2, it works but the number is still lower of 600 urls,
configuration:
Maximum pages: 0
Maximum depth level: 150
Maximum execution time, seconds: 0
Maximum memory usage, MB: 256
Save the script state, every X seconds:

could someone tell me what's wrong?

Thank you
Re: number of urls indexed suddenly decreased
« Reply #1 on: October 18, 2010, 09:40:17 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
Re: number of urls indexed suddenly decreased
« Reply #2 on: October 19, 2010, 05:02:31 PM »
Hi, I just sent you the data,
actually the generator renders 1300 reaching 27 links depth, while before V4 the links depth was set at 3 (not unlimited like now) and it generated much more, there must also be some problems with xls when viewing the sitemap with the browser (error message), I must say that the generator has run always smoothly, I have an installation (among others) which renders +11.000 urls without the slightest problem

Thank you for your support :)