XML Sitemaps Generator

Author Topic: Crawler stops working  (Read 11392 times)

menuspring.com

  • Approved member
  • *
  • Posts: 4
Crawler stops working
« on: December 25, 2012, 09:41:50 AM »
Hi, my crawler stops working after sometime although I have ticked the running in the background option. Any ideas?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Crawler stops working
« Reply #1 on: December 26, 2012, 02:26:15 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

menuspring.com

  • Approved member
  • *
  • Posts: 4
Crawler takes ages
« Reply #2 on: December 27, 2012, 10:32:45 AM »
Hi I started crawling a website a couple of days ago but it still keeps crawling. I have around 30k pages and wonder if usually takes that long?
« Last Edit: December 27, 2012, 11:05:39 AM by menuspring.com »

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Crawler stops working
« Reply #3 on: December 27, 2012, 10:15:14 PM »
What is your website URL?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

menuspring.com

  • Approved member
  • *
  • Posts: 4
Re: Crawler stops working
« Reply #4 on: December 27, 2012, 11:04:33 PM »
It's [external links are visible to admins only]

menuspring.com

  • Approved member
  • *
  • Posts: 4
Re: Crawler stops working
« Reply #5 on: December 28, 2012, 05:13:20 PM »
I just tried to crawl everything again. NOw it just crawls for a second and creates a sitemap with ONE url only. HOw can I access prior versions of the sitemap?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Crawler stops working
« Reply #6 on: December 29, 2012, 07:18:25 AM »
Replied to your email.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2