not indexing pages when i exclude a language url
« on: November 26, 2009, 11:22:01 AM »
Hi There

I have a very large site.. when I try to run the standalone generator without any exlcusions it is just going to be too big.. so I tried excluding lanuage URLs like this

ru/
es/

and not to parse new item urls with substring    start=

Then when I run it it only indexes the links directly from the homepage or maybe one level deep up to 178 links.. and misses out the deeper indexing I need in English without it going too far.. there must be at least 15k or 20k links to index in english language without following the URLs above..

When I remove the language excludes it seems to go and look for the whole site..

Why is this??

Lee