XML Sitemaps Generator

Author Topic: robots.txt network error by Google  (Read 19298 times)

acnz

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
robots.txt network error by Google
« on: July 23, 2007, 03:09:56 PM »
Finally ! A reason for a problem that seems to be plaguing a lot of people - this might be handy information.

You run sitemap generator perfectly.
It creates sitemap.xml and you can see it in your browser.
Submit to Google and the reply from Google is robots.txt unreachable.
You check in your browser and you can see it ok.

IS YOUR WEB HOST BLOCKING GOOGLE ??

This is a reply from my Host Providers:
"It is possible that their ip is blocked.
We have blocked some ips in different servers due to different reasons. Like
some spiders cause excessive access. For example,your website uses a lot of
sql and the spider visits your website frequently, it can cause a lot of
load to mysql and the server, then it will be blocked."

Solution ? Suggest that they UNBLOCK GOOGLE !!



XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: robots.txt network error by Google
« Reply #1 on: July 23, 2007, 08:32:31 PM »
Hello,

what is an example URL that you are trying to submit?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2