I've been trying to get the site I'm working on to crawl correctly however it keeps stopping on a certain page. I've tried using the tools on your site also: the headers return 200 correctly, however the SE tool returns nothing for Google and Yahoo but works correctly for MSN.
The link to the page stopping progress is: [external links are visible to admins only]. This comes off this page: [external links are visible to admins only] which works correctly.
Any ideas? Any help would be immensely appreciated!