Hello our generator is set to crawl "Make a delay between requests, X seconds after each N requests:
30 seconds after 20 requests." We do have a big site with over 74172 pages to crawl but it the generator keeps stopping with the following error
"Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 22388215 bytes) in"
Can you help us fix this?