Crawl error IDN domain name
« on: July 21, 2013, 03:23:47 PM »
Hi there,

I am trying do crawl the domain lumièredujour.fr.
I set the start URL to http://www.xn--lumiredujour-0db.fr/ and then i get this error:

Quote
There was an error while retrieving the URL specified: http://xn--lumiredujour-0db.fr/
HTTP Code:
HTTP/1.1 302 Found
HTTP headers:
date: Sun, 21 Jul 2013 14:11:07 GMT
server: Apache/2
location: http://www.xn--lumiredujour-0db.fr/
content-length: 294
connection: close
content-type: text/html; charset=iso-8859-1
x_csize: 294

HTTP output:
302 Found

Is this a website/server configuration error or a Sitemap Generator bug?
Re: Crawl error IDN domain name
« Reply #1 on: July 23, 2013, 06:31:14 AM »
Hello,

looks like you have specified xn--lumiredujour-0db.fr/  as starting URL instead of www.xn--lumiredujour-0db.fr/
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Crawl error IDN domain name
« Reply #2 on: July 23, 2013, 09:38:07 AM »
The www did the trick but i don't understand why?
In my .htaccess non www is redirected to www....
Re: Crawl error IDN domain name
« Reply #3 on: July 26, 2013, 07:47:27 AM »
Starting URL must be matching the resulting domain of the website.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.