XML Sitemaps Generator

Author Topic: crawling got interrupted every 10 mins  (Read 1987 times)

kirkma1991

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
crawling got interrupted every 10 mins
« on: May 21, 2016, 11:17:31 AM »
hello, purchased standalone and installed in my server

tried to run it manually and it just got interrupted about every 10 mins, don know why, tried lots of combination...
and i need to restart the crawling process every 10 mins now... not sure if corn job can do well..

following are config in php.ini
post_max_size = 20M
memory_limit = 200M
upload_max_filesize = 20M
max_execution_time = 9000

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: crawling got interrupted every 10 mins
« Reply #1 on: May 22, 2016, 06:04:14 AM »
Hello,  in this case I would recommend to run generator in command line if you have ssh access to your server.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

kirkma1991

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: crawling got interrupted every 10 mins
« Reply #2 on: May 22, 2016, 03:18:36 PM »
do not have ssh access...
would cron job do the job?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: crawling got interrupted every 10 mins
« Reply #3 on: May 23, 2016, 12:07:22 PM »
Yes, that should work.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2