max limit exhausted again

[ferdie]

we increased the php memory limit to 500mb and still it was exhausted. How much memory does this app need??
our site is about 350k pages.

[admin]

Hello,

that depends on what kind of pages you have, how many links to you have in average on every page and other factors. You can decrease memory usage by disabling ROR and HTML sitemaps generation.
Also, a major difference can make customization of crawler parameters with "Do not parse" / "Exclude URLs" options.