XML Sitemaps Generator

Author Topic: Crawling proccess interruption  (Read 3745 times)

ciottinga

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Crawling proccess interruption
« on: December 16, 2015, 03:30:37 PM »
Hello,
I just installed the unlimited version. I runned manually the crawling for the first time on the website. It started but it always stopped after 2 min every time I repeat the operation.
I waited also 2 hours but no more advance. I don't have sitemap yet.

Can you solve this problem?

Thank you
Luigi

gh

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Crawling proccess interruption
« Reply #1 on: December 17, 2015, 02:03:23 AM »
I have the same problem. It indexes the first 19 pages and then gets stuck.
In PHP.ini the max_execution_time is 60s
Memory limit 128MByte.
The previous version of XML sitemaps worked for me.
Help needed urgently.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Crawling proccess interruption
« Reply #2 on: December 17, 2015, 06:24:20 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

gh

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Crawling proccess interruption
« Reply #3 on: December 17, 2015, 11:18:02 AM »
Can you give me a rough number please, now the values are:
max_execution_time is 60s
Memory limit 128MByte.

Is the time needed a few more minutes or do I need hours?
How many MByte should I request from the provider? 200MB? or much more?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Crawling proccess interruption
« Reply #4 on: December 18, 2015, 07:10:26 AM »
Please try 1000 and 256M correspondingly.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2