Crawing Error - Looping Then Times Out
« on: November 04, 2008, 08:48:34 AM »
Why is this happening can any one explain.

It seems to be looping

I did have it over 25000 pages when I only have about 500 pages if that?

I have tried re-installing, looked at code of site, links, etc.

And it does not add anything to the site map?

 :'(


Links depth: 157
Current page: 1public/productsservices/productdetails/index.php?IDPROC=2Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising Website Advertising
Pages added to sitemap: 1793
Pages scanned: 1800 (30,152.9 KB)
Pages left: 1 (+ 19 queued for the next depth level)
Time passed: 3:01
Time left: 0:00
Memory usage: 23,377.9 Kb

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 7866797 bytes) in /home/yyorkshi/public_html/lincolnshirenetworks.org.uk/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6
Re: Crawing Error - Looping Then Times Out
« Reply #1 on: November 04, 2008, 09:15:48 PM »
Hello,

looks like you have an endless loop of link on your site, the easiest workaround is to set "maximum depth" option to say "30" to avoid endless crawling.