Crawl error IDN domain name
« on: July 21, 2013, 03:23:47 PM »
Hi there,

I am trying do crawl the domain lumièredujour.fr.
I set the start URL to [ External links are visible to forum administrators only ] and then i get this error:

Quote
There was an error while retrieving the URL specified: [ External links are visible to forum administrators only ]
HTTP Code:
HTTP/1.1 302 Found
HTTP headers:
date: Sun, 21 Jul 2013 14:11:07 GMT
server: Apache/2
location: [ External links are visible to forum administrators only ]
content-length: 294
connection: close
content-type: text/html; charset=iso-8859-1
x_csize: 294

HTTP output:
302 Found

Is this a website/server configuration error or a Sitemap Generator bug?
Re: Crawl error IDN domain name
« Reply #1 on: July 23, 2013, 06:31:14 AM »
Hello,

looks like you have specified xn--lumiredujour-0db.fr/  as starting URL instead of www.xn--lumiredujour-0db.fr/
Re: Crawl error IDN domain name
« Reply #2 on: July 23, 2013, 09:38:07 AM »
The www did the trick but i don't understand why?
In my .htaccess non www is redirected to www....