Crawling proccess interruption
« on: December 16, 2015, 03:30:37 PM »
Hello,
I just installed the unlimited version. I runned manually the crawling for the first time on the website. It started but it always stopped after 2 min every time I repeat the operation.
I waited also 2 hours but no more advance. I don't have sitemap yet.

Can you solve this problem?

Thank you
Luigi

gh

*
  • *
  • 2
Re: Crawling proccess interruption
« Reply #1 on: December 17, 2015, 02:03:23 AM »
I have the same problem. It indexes the first 19 pages and then gets stuck.
In PHP.ini the max_execution_time is 60s
Memory limit 128MByte.
The previous version of XML sitemaps worked for me.
Help needed urgently.
Re: Crawling proccess interruption
« Reply #2 on: December 17, 2015, 06:24:20 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 

gh

*
  • *
  • 2
Re: Crawling proccess interruption
« Reply #3 on: December 17, 2015, 11:18:02 AM »
Can you give me a rough number please, now the values are:
max_execution_time is 60s
Memory limit 128MByte.

Is the time needed a few more minutes or do I need hours?
How many MByte should I request from the provider? 200MB? or much more?