XML Sitemaps Generator

Author Topic: Starts crawl, then Internal Server Error  (Read 2758 times)

MalcB

  • Registered Customer
  • Approved member
  • *
  • Posts: 6
Starts crawl, then Internal Server Error
« on: April 29, 2016, 08:26:28 AM »
Crawling starts, then after just over a minute, it stops and shows the "Internal Server Error" message.

I have increased memory and execution time as follows:
memory_limit = 512M;
max_execution_time = 120;

Should I increase those limits even more or are there any other settings I should change?

I have PM'd the URL and login in case you need to take a look.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Starts crawl, then Internal Server Error
« Reply #1 on: April 30, 2016, 03:55:43 PM »
Hello,

you need to increase max_execution_time setting.
also,  in this case I would recommend to run generator in command line if you have ssh access to your server.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

MalcB

  • Registered Customer
  • Approved member
  • *
  • Posts: 6
Re: Starts crawl, then Internal Server Error
« Reply #2 on: May 02, 2016, 11:00:57 AM »
I increased the limits in php.ini as follows but I'm getting the "Internal Server Error" message:

memory_limit = 1024M;
max_execution_time = 600;

I also ran the following as a test for a scheduled CRON job from the hosting control panel:

/usr/bin/php /home/sites/soccerbilia.co.uk/public_html/generator/runcrawl.php

... but the test failed. I don't have SSH access but i can apply to have this granted if necessary.


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Starts crawl, then Internal Server Error
« Reply #3 on: May 03, 2016, 08:47:40 AM »
Hello,

what is the contents of email you get from the cron task?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

MalcB

  • Registered Customer
  • Approved member
  • *
  • Posts: 6
Re: Starts crawl, then Internal Server Error
« Reply #4 on: May 03, 2016, 10:21:52 AM »
Details from the email are in the attached text file.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Starts crawl, then Internal Server Error
« Reply #5 on: May 04, 2016, 10:32:25 AM »
Looks like the process has been completed via the cron task:

<h4>Completed</h4>Total pages indexed: 7584
<br>Creating sitemaps...
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

MalcB

  • Registered Customer
  • Approved member
  • *
  • Posts: 6
Re: Starts crawl, then Internal Server Error
« Reply #6 on: May 05, 2016, 07:52:34 AM »
I didn't spot that, sorry! Many thanks for all your help :)

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2