I've spent several weeks reading through peoples' similar problems here and have tried dozens of different combinations of settings, but still get the same old error:
Fatal error: Out of memory (allocated 101711872) (tried to allocate 11796471 bytes) in **** : eval()'d code on line 6
I've tried upping the memory in php.ini in increments, from 32 to 2048mb (phpinfo shows it to be accurate) and always get the same error, even if I set the crawley to pause between x number of pages.
On top of this it always times out, always, so I spend the better part of the day re-starting from the point at which it stopped, only to end with the same memory error each time.
Are there any other ideas besides the obvious increase memory and timeout?