XML Sitemaps Generator

Author Topic: Not Crawling Entire Site  (Read 9303 times)

adam21

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Not Crawling Entire Site
« on: June 29, 2011, 10:15:16 PM »
Hey There,

I have read threw a few topics on this, however I cannot find any solution.

Your free sitemap tool crawls my site perfectly (up to 500 pages)

After installing your script on [external links are visible to admins only] it only indexes around 152 pages out of over 25,000.

Am i missing some setting? Example of pages not crawled:

[external links are visible to admins only]
[external links are visible to admins only]
[external links are visible to admins only]

All pages are accessible from the home page.

Any thoughts?

Cheers,
Adam

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Not Crawling Entire Site
« Reply #1 on: June 30, 2011, 07:00:12 PM »
Hello,

replied to your email, looks like it's crawling many pages now.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2