XML Sitemaps Generator

Author Topic: Search Engine Robot Simulator giving error on page  (Read 19738 times)

st3v3

  • Approved member
  • *
  • Posts: 2
Search Engine Robot Simulator giving error on page
« on: September 11, 2008, 09:36:44 AM »
To check my site I used the Search Engine Robot Simulator on my site. The homepage URL gives the page and URLs correct, but when I click on a page 'under' the webroot, the Search Engine Robot Simulator gives the following error;

SE Bot Simulation Results
[url]
There was an error while retrieving the URL specified


When accessing the page in a browser, all looks fine (HTTP header '200 OK')... Furthermore, all pages are XHTML1.0Strict valid.

What could be causing this error/alert??

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Search Engine Robot Simulator giving error on page
« Reply #1 on: September 11, 2008, 05:31:00 PM »
Hello,

what is an example URL?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

st3v3

  • Approved member
  • *
  • Posts: 2
Re: Search Engine Robot Simulator giving error on page
« Reply #2 on: September 12, 2008, 07:12:04 AM »
The site is:
[external links are visible to admins only]
One of the URLs that causes an error, is:
[external links are visible to admins only]

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Search Engine Robot Simulator giving error on page
« Reply #3 on: September 12, 2008, 05:03:16 PM »
Please check now.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Search Engine Robot Simulator giving error on page
« Reply #4 on: September 12, 2008, 05:07:47 PM »
Actually, it looks like your site blocks all requests made with googlebot user-agent, as a restult Google cannot index your pages.
Compare this request done as "XML Sitemaps" user agent (HTTP Code 200 returned): http://www.xml-sitemaps.com/http-headers-viewer.html?op=http-headers-viewer&go=1&pageurl=http%3A%2F%2Fwww.humanofficeshop.nl%2Fproducten%2Fkantoormeubelen%2Fdefault.aspx&se=xmlsitemaps&submit=View

This is done as Google Bot (HTTP Code 500 returned): http://www.xml-sitemaps.com/http-headers-viewer.html?op=http-headers-viewer&go=1&pageurl=http%3A%2F%2Fwww.humanofficeshop.nl%2Fproducten%2Fkantoormeubelen%2Fdefault.aspx&se=googlebot&submit=View

You might want to address this issue (in your server configuration) asap.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2