Can xmp-sitemap run big website with many urls?
« on: December 04, 2010, 09:10:52 PM »
I tried one male enhancement product site, it is perfect. When I tried to run the dating site with many urls, then it shows this error.  Then, I increased the size in php.ini file as below:

max_execution_time = 50000
max_input_time 200000
memory_limit = 150M

It still shows error.

Then, I limited to ONLY 4 in depth link, it still shows error as below:

to-restart monitoring: Sat Dec 4 13:06:52 PST 2010 (13 second(s) since last update)Resuming the last session (last updated: 2010-12-04 15:51:55)
Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 25883610 bytes) /pages/class.utils.inc.php(2) : eval()'d code on line 27

Any advice is appreciated.

thanks.
Life is short, try to do something good!
Re: Can xmp-sitemap run big website with many urls?
« Reply #1 on: December 05, 2010, 05:11:27 PM »
Hello,

you need to increase memory_limit setting (try to set 512M in generator configuration)
Re: Can xmp-sitemap run big website with many urls?
« Reply #2 on: December 06, 2010, 09:18:46 PM »
It worked.

One more question, I created a cron job to run every day. Does the sitemap pick up the new pages ONLY or it does the whole process again? If so, it wastes a lot of memory usage every day?

thanks.
Life is short, try to do something good!
Re: Can xmp-sitemap run big website with many urls?
« Reply #3 on: December 06, 2010, 09:53:07 PM »
Hello,

generator needs to crawl the whole site, otherwise it won't be able to detect new pages (since they can be linked anywhere). For the large site, it's sufficient to regenerate sitemap once a week or so.