Not Crawling Entire Site
« on: June 29, 2011, 11:15:16 PM »
Hey There,

I have read threw a few topics on this, however I cannot find any solution.

Your free sitemap tool crawls my site perfectly (up to 500 pages)

After installing your script on [ External links are visible to forum administrators only ] it only indexes around 152 pages out of over 25,000.

Am i missing some setting? Example of pages not crawled:

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

All pages are accessible from the home page.

Any thoughts?

Cheers,
Adam