Crawling Stop and inform Fatal error !
« on: February 18, 2009, 01:07:29 PM »
I'm a new customer.I just buy your program today !

I have big site. My site create from associate-o-matic program.
This is my website : [ External links are visible to forum administrators only ]
My website with your XML program : [ External links are visible to forum administrators only ]

Crawling Stop and inform Error report as below :

Links depth: 21
Current page: shop.php?c=Campinggear&n=3375301&i=B000OTM1JA&x=Picnic_Time_Canterbury
Pages added to sitemap: 16560
Pages scanned: 16560 (405,466.7 KB)
Pages left: 427 (+ 462 queued for the next depth level)
Time passed: 101:19
Time left: 2:36
Memory usage: 16,859.4 Kb
Resuming the last session (last updated: 2009-02-18 04:50:48)
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 6195573 bytes) in /home/somboon/public_html/camp-shops.com/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6

Please help me with the best configuration to cover all pages in my site even if it will take long time but with no memory errors.
Thank you very much !
« Last Edit: February 18, 2009, 01:42:31 PM by aimstarteam11 »
Re: Crawling Stop and inform Fatal error !
« Reply #1 on: February 18, 2009, 09:34:32 PM »
Hello,

I see that you are running an Amazon partnered website, I've defined this crawler options for better performance:
Do not parse (still included in sitemap though):
Code: [Select]
&i=
&t=
Exclude:
Code: [Select]
&t=MinimumPlease check now.
Re: Crawling Stop and inform Fatal error !
« Reply #2 on: February 19, 2009, 12:23:33 AM »
Thank you for your help !

 ;D ;D :o

I am just try it again. I hope this time it will run well without problem.
Re: Crawling Stop and inform Fatal error !
« Reply #3 on: February 19, 2009, 01:47:44 AM »
I try it again but it still Error !  :'( :'(

Links depth: 23
Current page: shop.php?c=Backpacks&n=3375301&s=sr&p=295&x=Backpacks
Pages added to sitemap: 17720
Pages scanned: 17720 (88,971.6 KB)
Pages left: 576 (+ 116 queued for the next depth level)
Time passed: 58:21
Time left: 1:53
Memory usage: 17,055.9 Kb
Resuming the last session (last updated: 2009-02-18 16:43:03)
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 5415787 bytes) in /home/somboon/public_html/camp-shops.com/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6
Re: Crawling Stop and inform Fatal error !
« Reply #4 on: February 19, 2009, 01:37:14 PM »

Please you help me ! I would like program work and not error !
Thank you very much  ::)
Re: Crawling Stop and inform Fatal error !
« Reply #5 on: February 19, 2009, 10:55:00 PM »
I've upped the memory limit setting and resumed generation, let's see how it goes!
Re: Crawling Stop and inform Fatal error !
« Reply #6 on: February 20, 2009, 12:57:31 PM »
It work well now !
Thank you for your help ! :)