PowWeb problems
« on: October 12, 2006, 04:34:52 AM »
I do not have access to php.ini 
I'm using the newest version 2.4
 I am hosted on PowWeb.
I've set the save state time to 45 seconds with 0 delay between requests. (I think the timeout on PowWeb is 60seconds)
I can only get to 219 pages and it says it's crawling but it isn't.
Do you have any knowledge of PowWeb and how I might need to setup for that hosting company?

Thanks,
Granny
Re: PowWeb problems
« Reply #1 on: October 13, 2006, 01:30:31 AM »
Hello Granny,

in case if the script times out, you should restart crawler with "resume generation" checkbox enabled until the full sitemap is created.
Re: PowWeb problems
« Reply #2 on: October 13, 2006, 03:28:51 PM »
Hello Granny,

in case if the script times out, you should restart crawler with "resume generation" checkbox enabled until the full sitemap is created.

I can't tell you how many times I've done that to no avail.  However, I did find my php.ini at PowWeb and have made some timeout changes to it. I changed the 60 sec time to 120 and the 300 timeout to 3000.
 I'm trying it out now.    :)
Re: PowWeb problems
« Reply #3 on: October 13, 2006, 05:25:16 PM »
OK-I've attempted a map of only 2000 pages. The crawler got to 719 and then gave me this:
Fatal error: Allowed memory size of 29360128 bytes exhausted (tried to allocate 131 bytes) in /path/to/my/powweb/htdocs/dir of sitemap generator/pages/class.grab.inc.php(2) : eval()'d code on line 266

What can I change now to make it work?
I didn't have any problems with this until I started generating dynamic pages and went over 500 pages.  Another site of mine (diff server) has no problems at all generating the limit I have given it of 2000. On the other hand, This space maps 500 pages with no problem.....but I can do that for free!  Help me out here.

UPDATE: OK I went back to php.ini and changed this line:
memory_limit = 29M  to memory_limit = 50M   
Made sense to me, and so far it's working. I'm at about 1100 pages. I"ll post back if I have more trouble.
« Last Edit: October 13, 2006, 06:35:42 PM by grannysgold »
Re: PowWeb problems
« Reply #4 on: October 13, 2006, 10:50:50 PM »
Quote
Made sense to me, and so far it's working. I'm at about 1100 pages. I"ll post back if I have more trouble.
Great, let us know how it goes.