XML Sitemaps Generator

Author Topic: Crawler stops after crawling few pages  (Read 3818 times)

promrinal

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Crawler stops after crawling few pages
« on: February 06, 2016, 04:57:36 PM »
Please solve this issue, crawler stops crawling after crawling few pages and I have to start it again and again.


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Crawler stops after crawling few pages
« Reply #1 on: February 07, 2016, 07:49:46 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

promrinal

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: Crawler stops after crawling few pages
« Reply #2 on: February 17, 2016, 05:38:33 AM »
I updated the php.ini file and it worked fine for 2 times but now again the crawler stops after crawling 350 pages and wont crawl further. Every time it auto restarts and starts crawling from 1.

[external links are visible to admins only]
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Crawler stops after crawling few pages
« Reply #3 on: February 17, 2016, 05:39:28 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

promrinal

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: Crawler stops after crawling few pages
« Reply #4 on: February 18, 2016, 04:13:52 PM »
I sent you the url, please fix this soon.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Crawler stops after crawling few pages
« Reply #5 on: February 19, 2016, 04:56:46 AM »
Hello,

replied to your PM.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2