XML Sitemaps Generator

Author Topic: Can xmp-sitemap run big website with many urls?  (Read 9533 times)

tadisaus2

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
Can xmp-sitemap run big website with many urls?
« on: December 04, 2010, 09:10:52 PM »
I tried one male enhancement product site, it is perfect. When I tried to run the dating site with many urls, then it shows this error.  Then, I increased the size in php.ini file as below:

max_execution_time = 50000
max_input_time 200000
memory_limit = 150M

It still shows error.

Then, I limited to ONLY 4 in depth link, it still shows error as below:

to-restart monitoring: Sat Dec 4 13:06:52 PST 2010 (13 second(s) since last update)Resuming the last session (last updated: 2010-12-04 15:51:55)
Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 25883610 bytes) /pages/class.utils.inc.php(2) : eval()'d code on line 27

Any advice is appreciated.

thanks.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Can xmp-sitemap run big website with many urls?
« Reply #1 on: December 05, 2010, 05:11:27 PM »
Hello,

you need to increase memory_limit setting (try to set 512M in generator configuration)
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

tadisaus2

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
Re: Can xmp-sitemap run big website with many urls?
« Reply #2 on: December 06, 2010, 09:18:46 PM »
It worked.

One more question, I created a cron job to run every day. Does the sitemap pick up the new pages ONLY or it does the whole process again? If so, it wastes a lot of memory usage every day?

thanks.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Can xmp-sitemap run big website with many urls?
« Reply #3 on: December 06, 2010, 09:53:07 PM »
Hello,

generator needs to crawl the whole site, otherwise it won't be able to detect new pages (since they can be linked anywhere). For the large site, it's sufficient to regenerate sitemap once a week or so.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2