No Stop Link When Crawling
« on: April 08, 2009, 05:43:35 PM »
The documentation says:
Quote
There you will also find the link to stop the script, which is very useful for big sites because you don't have to wait until it is finished if you want to modify the configuration and re-run the script.
I don't have this available in Firefox or IE 7.
Re: No Stop Link When Crawling
« Reply #1 on: April 08, 2009, 09:48:33 PM »
Hello,

the link is only displayed in case if the script is currently running in with "run in background" option enabled.
Re: No Stop Link When Crawling
« Reply #2 on: April 09, 2009, 04:22:16 AM »
I see a  "click here to interrupt it" link in the status while running from Cron.
Re: No Stop Link When Crawling
« Reply #3 on: April 10, 2009, 01:11:18 AM »
Quote
the link is only displayed in case if the script is currently running in with "run in background" option enabled.
I'm running it like that in Firefox right now and there is no "stop" link that I can see.
Re: No Stop Link When Crawling
« Reply #4 on: April 10, 2009, 02:11:18 PM »
Please check your generator/data/ folder and see if there is "crawl_state.log" file created.
Re: No Stop Link When Crawling
« Reply #5 on: April 10, 2009, 03:30:54 PM »
The only thing close to that is the crawl_dump.log
Re: No Stop Link When Crawling
« Reply #6 on: April 10, 2009, 06:02:09 PM »
It's running right now and I see no way to stop it and would really like to.
Re: No Stop Link When Crawling
« Reply #7 on: April 11, 2009, 03:20:06 AM »
Please try to increase max_execution_time and memory_limit settings in PHP configiration.
Re: No Stop Link When Crawling
« Reply #8 on: April 11, 2009, 05:36:18 AM »
I'm running with 128MB allocated and it still keeps dying. This might help.
Quote
Links depth: 4
Current page: lighting_cat/9199-848/sea-gull-lighting---9199-848.html
Pages added to sitemap: 36654
Pages scanned: 45400 (475,018.7 KB)
Pages left: 41843 (+ 0 queued for the next depth level)
Time passed: 109:56
Time left: 101:19
Memory usage: 59,437.2 Kb
Resuming the last session (last updated: 2009-04-10 23:30:06)
Fatal error: Allowed memory size of 125829120 bytes exhausted (tried to allocate 16777295 bytes) in /home/furnitur/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 6