XML Sitemaps Generator

Author Topic: Not all pages being crawled  (Read 15535 times)

roofingmatch

  • Approved member
  • *
  • Posts: 3
Not all pages being crawled
« on: December 09, 2008, 06:56:13 PM »
Hello,

I've used your service for several of my other sites and haven't had this problem.

It is leaving out about half of my pages.  The URL is [external links are visible to admins only]

it seems to be leaving out each of these pages:  [external links are visible to admins only]
for each US state.

Any help would be greatly appreciated!

Thanks-

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Not all pages being crawled
« Reply #1 on: December 09, 2008, 09:40:10 PM »
Hello,

please check our "search engine robot simulator" tool  to see if those pages are crawlable: http://www.xml-sitemaps.com/se-bot-simulator.html
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

roofingmatch

  • Approved member
  • *
  • Posts: 3

roofingmatch

  • Approved member
  • *
  • Posts: 3
Re: Not all pages being crawled
« Reply #3 on: December 10, 2008, 01:56:29 AM »
i figured it out

the reason is because there were no direct links going to those pages.  only links were from drop downs...

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2