XML Sitemaps Discussions Category > Unlimited PHP Sitemap Generator

Can xmp-sitemap run big website with many urls?


I tried one male enhancement product site, it is perfect. When I tried to run the dating site with many urls, then it shows this error.  Then, I increased the size in php.ini file as below:

max_execution_time = 50000
max_input_time 200000
memory_limit = 150M

It still shows error.

Then, I limited to ONLY 4 in depth link, it still shows error as below:

to-restart monitoring: Sat Dec 4 13:06:52 PST 2010 (13 second(s) since last update)Resuming the last session (last updated: 2010-12-04 15:51:55)
Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 25883610 bytes) /pages/class.utils.inc.php(2) : eval()'d code on line 27

Any advice is appreciated.


XML-Sitemaps Support:

you need to increase memory_limit setting (try to set 512M in generator configuration)

It worked.

One more question, I created a cron job to run every day. Does the sitemap pick up the new pages ONLY or it does the whole process again? If so, it wastes a lot of memory usage every day?


XML-Sitemaps Support:

generator needs to crawl the whole site, otherwise it won't be able to detect new pages (since they can be linked anywhere). For the large site, it's sufficient to regenerate sitemap once a week or so.


[0] Message Index

Go to full version