I have successfully installed this software and it works very well however, I am very please with it - one problem is that it does not follow all the links on a page.
I have a link like this on the Homepage - (and on other pages too):-
[external links are visible to admins only]
- and it is NOT in the sitemap - and it doesn't follow the links on that page either!
btw: real site is [external links are visible to admins only]
any ideas why links like this are not being indexed / crawled / followed ?
(this is not a rel=nofollow issue)