Free Online
Sitemap Generator
Unlimited
Sitemap Generator
About Sitemaps
Broken Links
Forum
Testimonials
Tools
Contact
Advanced search
Sitemap Generator Forum
July 20, 2008, 07:11:49 PM
Welcome,
Guest
. Please
login
or
register
.
Did you miss your
activation email?
1 Hour
1 Day
1 Week
1 Month
Forever
Login with username, password and session length
Home
Help
Search
Login
Register
Sitemap software 2.9 released
- Email notifications, html sitemap customizing and more
6813
Posts in
1681
Topics by
Members
Latest Member:
info607
Sitemap Generator Forum
>
XML Sitemaps Discussions Category
>
Bug reporting for Standalone Sitemap Generator
>
bloked during crawl
Pages: [
1
]
« previous
next »
Print
Author
Topic: bloked during crawl (Read 4952 times)
franck.box
Registered Customer
Newbie
Posts: 2
bloked during crawl
«
on:
August 08, 2007, 05:39:17 AM »
hello,
I was using sitemap generator without problems until few days ago. Now the sitemap generator can crawl only a limited number of pages. I saw the error when I analysed the html sitemap generated. The sitemap display "You were blocked" for a lot of urls and the sitemap generated have only 130 pages instead thousands.
Can you help please?
Logged
admin
Administrator
Hero Member
Posts: 2837
Re: bloked during crawl
«
Reply #1 on:
August 08, 2007, 08:02:35 PM »
Hello,
perhaps your site blocks requests since sitemap generator crawls your site too intensively. Please try to use "Make delay for X seconds" option to insert delays between requests and make crawling slower.
Logged
Oleg Ignatiuk
http://www.xml-sitemaps.com
franck.box
Registered Customer
Newbie
Posts: 2
Re: bloked during crawl
«
Reply #2 on:
August 09, 2007, 05:08:23 AM »
Hello,
I resolved the problem removing a script I installed to prevent SQL injection, php injection and flood.
Thanks!
Logged
admin
Administrator
Hero Member
Posts: 2837
Re: bloked during crawl
«
Reply #3 on:
August 09, 2007, 10:09:51 PM »
I see, thank you for update
Logged
Oleg Ignatiuk
http://www.xml-sitemaps.com
Pages: [
1
]
Print
« previous
next »
Jump to:
Please select a destination:
-----------------------------
XML Sitemaps Discussions Category
-----------------------------
=> Unlimited PHP Sitemap Generator
=> Bug reporting for Standalone Sitemap Generator
=> Free Online Sitemaps Generator
=> Site maps - General Discussion
Loading...