XML Sitemaps Generator

Author Topic: help ! The crawler never finishes. Any idea why ?  (Read 25285 times)

mpamphile

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
help ! The crawler never finishes. Any idea why ?
« on: September 01, 2006, 02:52:36 PM »
I have over 100,000 pages on my website.  The crawler never finishes.  Any idea why ?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: help ! The crawler never finishes. Any idea why ?
« Reply #1 on: September 02, 2006, 05:22:29 PM »
Hello,

as described in Cannot complete sitemap generation - crawler stops after some time:
Quote
- increase max_execution_time setting in php.ini file at your server and restart apache
- execute sitemap generator from command line (if you have ssh access to your server)
- use "Save state" option at Sitemap Generator configuration page and execute the crawler multiple times with "Resume generation" enabled until full sitemap is created
- limit the number of pages to index in Sitemap Generator configuration
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

bagros

  • Registered Customer
  • Approved member
  • *
  • Posts: 7
Re: help ! The crawler never finishes. Any idea why ?
« Reply #2 on: September 02, 2006, 06:11:34 PM »
Maybe U can add <java script> and test, run again to end crawling?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: help ! The crawler never finishes. Any idea why ?
« Reply #3 on: September 05, 2006, 02:22:10 AM »
Thank you for suggestion, we will consider this option for the next versions of sitemap generator.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2