XML Sitemaps Generator

Author Topic: Memory Exausted  (Read 88238 times)

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Memory Exausted
« Reply #15 on: August 02, 2005, 12:21:08 PM »
Hi,

when talking about optimizing of your website I don't mean to reduce the number of pages on your site! I mean the optimization of the script that works at your site to produce pages (I assume it is database-driven). For instance, if the page on your site is prepared in average 2 seconds, then for 500,000 pages it will take AT LEAST 1,000,000 seconds (more than 11 days). But if your site produces the pages within 0,2 seconds each (because of software or hardware improvement), then the same sitemap will be created within 2 days (approximately).
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

bug-software

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 15
Re: Memory Exausted
« Reply #16 on: August 03, 2005, 01:20:36 PM »
Still going :(

'146295',
'374660',
'881,603.8',
'12447:24',
'4860:23',
'6',
'327,682.6 Kb',
'374653',
'110349'
);</script>

And I don't think I can improve it more. It's a Dediated Dual Xeon with 1GB of Ram just for this site.

And I am starting to get concerned because the server begins to slow down.

I would really love the resume feature or at least that the memory wouldn't be eat this much.,

Right now the script is using '327,682.6 Kb'  and it's starting to slow it down.

Is there any change we can write some sort of written agreement and you disclose the source code? We really need the site indexed and I am guessing in 1 or 2 days it will stop.

I don't mind the time. What I can't face it anymore is the fact that the system locks and I start all over again so I kind of need a backup plan.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Memory Exausted
« Reply #17 on: August 03, 2005, 04:18:53 PM »
Hi,

sure, I know it's too bad for a huge site to have sitemap generation interrupted without a chance to continue from the break point.
I will make sure to include the script state backup with a "resume crawling" feature in the next release. Is that ok?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

bug-software

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 15
Re: Memory Exausted
« Reply #18 on: August 03, 2005, 05:13:50 PM »
Yes. That would be great.

bug-software

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 15
Re: Memory Exausted
« Reply #19 on: August 03, 2005, 05:14:20 PM »
By the way, it crashed :(

'144335',
'376620',
'885,526.8',
'12687:12',
'4862:12',
'6',
'328,878.0 Kb',
'376613',
'112434'
);</script>

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Memory Exausted
« Reply #20 on: August 09, 2005, 04:55:45 PM »
Hi,

please check the new generator version - the "resume operation" feature is added to 1.1.0 release.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2