Not all pages being crawled
« on: December 09, 2008, 06:56:13 PM »
Hello,

I've used your service for several of my other sites and haven't had this problem.

It is leaving out about half of my pages.  The URL is http://www.roofing-match.com

it seems to be leaving out each of these pages:  http://www.roofing-match.comroofing-price-quote-alabama.html
for each US state.

Any help would be greatly appreciated!

Thanks-
Re: Not all pages being crawled
« Reply #1 on: December 09, 2008, 09:40:10 PM »
Hello,

please check our "search engine robot simulator" tool  to see if those pages are crawlable: http://www.xml-sitemaps.com/se-bot-simulator.html
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Not all pages being crawled
« Reply #3 on: December 10, 2008, 01:56:29 AM »
i figured it out

the reason is because there were no direct links going to those pages.  only links were from drop downs...