sitemap generator - An error occured
« on: July 31, 2008, 06:45:39 AM »
Hi there,

I've trying to generate a sitemap for a secure (only) site:
[ External links are visible to forum administrators only ]

I've tried doing a 'Header View' via the tools section of this site, and they keep coming back with 302 (Redirect's), which is obviously bad.

But when I check the http headers from my browser (using firefox's webmaster plugin) it shows the headers as 200 (OK).

Further, looking at the logs on the web server, I see the same thing:
Code: [Select]
202.*.*.* - [30/Jul/2008:22:25:47 -0700] "GET / HTTP/1.1" 200 9923 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv: Gecko/2008070208 Firefox/3.0.1" - [30/Jul/2008:22:26:17 -0700] "GET / HTTP/1.0" 302 - "" "Mozilla/5.0 (XML Sitemaps Generator 1.0)"

What's interesting is that XMl Sitemaps uses a HTTP 1.0 client, while firefox is HTTP 1.1.

Does anyone know if there is a web server setting that might be causing non 1.1 HTTP clients to be redirected? Or is there something else going on here which I've failed to pickup on.

Re: sitemap generator - An error occured
« Reply #1 on: July 31, 2008, 03:51:53 PM »

sitemap generator supports http/1.1 protocol, but crawling of https pages is not currently supported.
With standalone sitemap generator you can crawl https sites if your server supports Curl/openSSL.