I have a very large site.. when I try to run the standalone generator without any exlcusions it is just going to be too big.. so I tried excluding lanuage URLs like this
and not to parse new item urls with substring start=
Then when I run it it only indexes the links directly from the homepage or maybe one level deep up to 178 links.. and misses out the deeper indexing I need in English without it going too far.. there must be at least 15k or 20k links to index in english language without following the URLs above..
When I remove the language excludes it seems to go and look for the whole site..
Why is this??