Not indexing all pages
« on: February 07, 2007, 10:46:09 AM »
Hello,

I have bought the standalone version a few days ago, and I have some problems with it.
Our website is available in 3 languages, and I can't have all the pages indexed in every language.
The default language of our website is french and I start crawling from the root (www.faunhome.be).
The crawler seems to index all the pages in english, but not in the 2 other languages.
He begins to add some of the pages and categories in french and dutch, then he switch in english and stay on it.
Note that all the pages are dynamic, we are using PHP with mod rewrite.

Any idea of what's going wrong ?

Here are some examples of pages or categories that are not indexed :
http://www.faunhome.be/kits-complets-c110.html
http://www.faunhome.be/aquarium-complet-boyu-mt50-noir-p573.html
http://www.faunhome.be/pompe-centrifuge-micra-sicce-p669.html
http://www.faunhome.be/habitat-c85.html
....

Thanks for your help.
Re: Not indexing all pages
« Reply #1 on: February 07, 2007, 11:47:09 PM »
Hello,

your language selector uses javascript:
Code: [Select]
onclick="javascript: self.location='index.php?target=products&product_id=2&sl=EN';"
You should use normal HTML links (<a href="">) to get these pages indexed.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Not indexing all pages
« Reply #2 on: February 08, 2007, 10:50:16 AM »
Hello,

You are right about the flags at the top of the pages, but you can find normal links at the bottom of the pages:

Code: [Select]
<td class="bottom-copyright" align="center">
<a href="http://www.faunhome.be/index.php?&sl=FR">Fran&ccedil;ais</a> |
<a href="http://www.faunhome.be/index.php?&sl=NL">Nederlands</a> |
<a href="http://www.faunhome.be/index.php?&sl=EN">English</a>

Best regards,

Regis
Re: Not indexing all pages
« Reply #3 on: February 09, 2007, 12:25:30 AM »
Hello,

javascript links point to the same page in different languages, while the bottom links are always pointing to homepage. That's why they are not indexed.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.