Getting a 403 forbidden error when crawling
« on: December 31, 2008, 06:30:33 PM »
Hi, I just tried to do a crawl of my site and I'm getting a 403 forbidden error:

An error occured: There was an error while retrieving the URL specified: [ External links are visible to forum administrators only ]
HTTP headers follow:
HTTP/1.1 403 Forbidden Date: Wed, 31 Dec 2008 18:26:11 GMT Server: Apache/2.2.3 (CentOS) X-Powered-By: PHP/5.1.6 Content-Length: 3 Connection: close Content-Type: text/html
HTTP output:


Now, the reason why I got this sitemap is because Google Webmaster tools has been showing 403 errors for 19,000 pages. I don't know why that is.

Any suggestions or input as to what the problem is or how to fix it?
Re: Getting a 403 forbidden error when crawling
« Reply #1 on: January 02, 2009, 07:27:22 AM »
The support here is pretty poor. Especially for a product I paid for. I finally found the problem myself. It appears my site had flood protection and it banned the server host the site iis on.


Thanks,

Michael
« Last Edit: January 03, 2009, 08:17:03 AM by admin »
Re: Getting a 403 forbidden error when crawling
« Reply #2 on: January 03, 2009, 08:17:37 AM »
Hello,

sorry for delay due to the holidays season, I'm glad you've got the issue resolved.