Amount of memory required?

[admin]

Thank you for details, it seems to be related to a PHP serialize function memory leak issue. Replied to you via PM.

[virtualdude]

Still does not work.......... 

[admin]

Hello,

as I see, sitemap has been created successfully in your case:

Request date:
30 July 2007, 21:52
Processing time:
1078.10s
Pages indexed:
61

[virtualdude]

That's for the test without indexing HTML files. For the real sitemap run, I want to index HTML files.

[virtualdude]

I have been trying to get this to work for over 1 week now and I am getting really angry. I cannot get the crawl to complete. Even if it I try to resume, it will somehow crash and start from ZERO again. Don't believe me, login to my account and try it out yourself.

[virtualdude]

I tried to generate my sitemap again. It stopped at about 12000 + pages. I tried to resume manually and it stopped at around 15000+ pages. I tried to resume from there again manually. At some point, the number of pages indexed gets reset to ZERO.

[admin]

Replied to your private message, sitemap has been created successfully (more than 30,000 URLs indexed).