XML Sitemaps Generator

Author Topic: Sitemap Collapses Near To End Of Crawl  (Read 8363 times)

woolfcom

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 23
Sitemap Collapses Near To End Of Crawl
« on: October 16, 2012, 07:40:14 AM »
My sitemap crawl collapses just before the end of the crawl.

Can I use the crawl_dump.log top generate a site map with what has been crawled to that point?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Sitemap Collapses Near To End Of Crawl
« Reply #1 on: October 17, 2012, 12:20:51 AM »
You can set "Maximum pages" setting to a lower number of resume generator and it will not crawl any more pages.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

woolfcom

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 23
Re: Sitemap Collapses Near To End Of Crawl
« Reply #2 on: October 18, 2012, 10:31:00 AM »
No thats not what i am asking.

Is there anyway of generating a site map from the pages which have been crawled to that point.

The problem is that the crawl for the 9k pages took about one week to generate [and has had to be manually re-started a few dozen times] - so I would wish to avoid running it again.

Please advise?


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Sitemap Collapses Near To End Of Crawl
« Reply #3 on: October 18, 2012, 12:02:54 PM »
That's correct - you would run generator again, resuming the process so it will read the progress form crawl_dump file and create sitemap without crawling any more pages.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

woolfcom

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 23
Re: Sitemap Collapses Near To End Of Crawl
« Reply #4 on: October 18, 2012, 12:14:11 PM »
I now see!

thank you.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2