XML Sitemaps Generator

Author Topic: crawler has indexed 6,160 pages while my site has over 20,000...  (Read 11767 times)

yossi

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
crawler has indexed 6,160 pages while my site has over 20,000...
« on: September 03, 2009, 09:45:29 AM »
hello,

I've created this site map [external links are visible to admins only] with Standalone Sitemap Generator.
Despite the fact that my site contains a business directory which has more than 10,000 businesses - each diplayed in two separate pages (in different languages) in addition to other content pages like news, articles etc. the crawler has indexed only 6160 pages.

when i look at the site map i can see that many categories in my directory are partly indexed.
for expmale:
here [external links are visible to admins only]
under Supermarkets category there is only one page titled "bar kol" although you can see that this category in the site  [external links are visible to admins only] has over 50 businesses

 

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: crawler has indexed 6,160 pages while my site has over 20,000...
« Reply #1 on: September 03, 2009, 09:03:21 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting  from homepage?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2