We run some large affiliate and aggregated content sites and are having some problems establishing the optimum link depth settings.
If we run the sitemaps with no link depth limits, they essentially never finish (assumably because they get into a loop).
Sitemaps do finish with reasonable time with a link-depth of 30, but I have noticed that google does not initially appear to index the pages.
However, with a lower link-depth (10, for example), google appears to immediately index most of the pages.
Does anyone have ideas on the following questions: -
1. Is there a standard optimum link depth setting?
2. Is there a connection between link depth and indexing of pages by google? (i.e. does google more readily index pages referenced in a sitemap generated within a lower link-depth setting?).
3. It is better to create sitemaps with more page that are not immediately indexed or less pages that are immediately indexed?
Thanks very much for your help.