not indexing pages when i exclude a language url
« on: November 26, 2009, 11:22:01 AM »
Hi There

I have a very large site.. when I try to run the standalone generator without any exlcusions it is just going to be too big.. so I tried excluding lanuage URLs like this


and not to parse new item urls with substring    start=

Then when I run it it only indexes the links directly from the homepage or maybe one level deep up to 178 links.. and misses out the deeper indexing I need in English without it going too far.. there must be at least 15k or 20k links to index in english language without following the URLs above..

When I remove the language excludes it seems to go and look for the whole site..

Why is this??

Re: not indexing pages when i exclude a language url
« Reply #1 on: November 26, 2009, 08:45:08 PM »

please let me know your generator URL/login to check that.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.