There was an error while retrieving the URL specified...

[gorsky]

This message keeps popping up when I try to start the crawler.  I set my IP to 127.0.0.1 and this error is still popping up.  I've also tried leaving off the http://www  and the error is still there.  I am sitting here connected to my server and it's working just fine, and I know the URL itself is up and running.  Any other suggestions?

The full message reads:
There was an error while retrieving the URL specified: [ External links are visible to forum administrators only ]
HTTP headers follow:
content-type: text/html
date: Thu, 24 Mar 2011 22:15:25 GMT
connection: close
content-length: 34

HTTP output:
Bad Request (Invalid URL)

[XML-Sitemaps Support]

Hello,

please let me know your generator URL/login  to check this: https://www.xml-sitemaps.com/contact.html

[gorsky]

Can you make this a private message?  I'd rather not have the link posted for everyone to see, but I don't have permission to send you a direct message.

[ External links are visible to forum administrators only ]

I did not set up a login yet so it will be whatever the default is.

[XML-Sitemaps Support]

Probably there is a configuration problem - it looks like your server doesn't allow local network connections via port 80 (http) - as a result sitemap generator is not able to crawl the site. This is usually related to firewall installed at the host - could you please contact your hosting support regarding this?

[gorsky]

Our systems admin assures me this isn't the case.  Is there anything else I can try?  Right now it fluctuates between a "socket error" and "error while retrieving the URL specified".  This is getting very frustrating and I'm worried I wasted my money and should just try different software.

[XML-Sitemaps Support]

Hello,

I just tried to change starting URL in your generator configuration to external website (google.com as an example), and crawler worked fine (limited it to 1 page for testing) - it means that the problem happens only when connecting to local site (same domain where generator is installed) and it's configured by an internal server firewall.

[staff5]

Hi I had the same issue, it was because I had a temporary redirect from the home page, check your temp or perm redirects, also I was missing the "www" on the url portion ... once I changed both it worked like a charm!
Cheers!