XML Sitemaps Generator

Author Topic: Crawl error IDN domain name  (Read 16223 times)

dorine

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Crawl error IDN domain name
« on: July 21, 2013, 02:23:47 PM »
Hi there,

I am trying do crawl the domain lumièredujour.fr.
I set the start URL to [external links are visible to admins only] and then i get this error:

Quote
There was an error while retrieving the URL specified: [external links are visible to admins only]
HTTP Code:
HTTP/1.1 302 Found
HTTP headers:
date: Sun, 21 Jul 2013 14:11:07 GMT
server: Apache/2
location: [external links are visible to admins only]
content-length: 294
connection: close
content-type: text/html; charset=iso-8859-1
x_csize: 294

HTTP output:
302 Found

Is this a website/server configuration error or a Sitemap Generator bug?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Crawl error IDN domain name
« Reply #1 on: July 23, 2013, 05:31:14 AM »
Hello,

looks like you have specified xn--lumiredujour-0db.fr/  as starting URL instead of www.xn--lumiredujour-0db.fr/
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dorine

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Crawl error IDN domain name
« Reply #2 on: July 23, 2013, 08:38:07 AM »
The www did the trick but i don't understand why?
In my .htaccess non www is redirected to www....

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Crawl error IDN domain name
« Reply #3 on: July 26, 2013, 06:47:27 AM »
Starting URL must be matching the resulting domain of the website.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2