I get the following error whenever I try t crawl
There was an error while retrieving the URL specified:http://www.mysite.com/
I have gone through the archives and tried everything posted to no avail.
Help
Hello,

please let me know your generator URL/login in private message to check this.
I have de same error:

ERROR:
There was an error while retrieving the URL specified: [ External links are visible to forum administrators only ]
HTTP headers follow:
date: Tue, 02 Aug 2011 16:48:22 GMT
server: Apache mod_fcgid/2.3.6 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635
vary: Cookie
x-pingback: [ External links are visible to forum administrators only ]
location: [ External links are visible to forum administrators only ]
content-length: 0
connection: close
content-type: text/html; charset=UTF-8

Hello,

you should use [ External links are visible to forum administrators only ] instead of domain.com as Starting URL.
Thanks! This work!