Crawler stops after crawling few pages
« on: February 06, 2016, 04:57:36 PM »
Please solve this issue, crawler stops crawling after crawling few pages and I have to start it again and again.

Re: Crawler stops after crawling few pages
« Reply #1 on: February 07, 2016, 07:49:46 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Re: Crawler stops after crawling few pages
« Reply #2 on: February 17, 2016, 05:38:33 AM »
I updated the php.ini file and it worked fine for 2 times but now again the crawler stops after crawling 350 pages and wont crawl further. Every time it auto restarts and starts crawling from 1.

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Re: Crawler stops after crawling few pages
« Reply #3 on: February 17, 2016, 05:39:28 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: Crawler stops after crawling few pages
« Reply #4 on: February 18, 2016, 04:13:52 PM »
I sent you the url, please fix this soon.