XML Sitemaps Generator

Author Topic: Crawling stop after few minutes  (Read 14454 times)

lunamoon

  • Registered Customer
  • Approved member
  • *
  • Posts: 6
Crawling stop after few minutes
« on: January 12, 2009, 11:53:16 AM »
Hello,
on one of my site, crawling stop after few hundreds minutes:

Please wait. Sitemap generation in progress...
Links depth: 2
Current page: departement/information-dep_num-51-d-Marne.html
Pages added to sitemap: 235
Pages scanned: 240 (6,079.4 KB)
Pages left: 515 (+ 5754 queued for the next depth level)
Time passed: 3:37
Time left: 7:46
Memory usage: 2,832.3 Kb

but nothing happend.  Crawling seems stopped but  if I go to another item on the menu, then crawl again.
No sitemap are generated.

Thanks in advance

Alain

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Crawling stop after few minutes
« Reply #1 on: January 12, 2009, 11:41:00 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

admin253

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Re: Crawling stop after few minutes
« Reply #2 on: April 06, 2009, 04:57:51 PM »
Hello I see you mention changing the memory limit and max execution time but to how much?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Crawling stop after few minutes
« Reply #3 on: April 07, 2009, 02:19:43 AM »
Try to set it to "128M" and "9000" correspondingly.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

fadetoblackradio

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: Crawling stop after few minutes
« Reply #4 on: April 14, 2009, 10:16:41 AM »
ive had the same problem, but being a seasoned webmaster id already dabbled with these settings, still nothing.

if i install a webserver on my pc and install this script where i have more control, can i sitemap a remote url,like on your website?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Crawling stop after few minutes
« Reply #5 on: April 14, 2009, 08:42:33 PM »
Hello,

yes, you can create sitemap for your website remotely from your local PC.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2