Cron Job Error
« on: July 09, 2014, 06:30:36 PM »
I have set up a cron job to generate a new sitemap every day based on the instructions given in the documentation.  It's not working and we get this error (ourdomain.com used as an example):

<h4>An error occured: </h4> <script> top.location = 'index.php?op=config&errmsg=%3Cb%3EThere+was+an+error+while+retrieving+the+URL+specified%3A%3C%2Fb%3E+http%3A%2F%2Fourdomain.com%2F%3Cbr%3E%3Cb%3EHTTP+Code%3A%3C%2Fb%3E%3Cbr%3E%3Cbr%3E%3Cb%3EHTTP+headers%3A%3C%2Fb%3E%3Cbr%3Ex_csize%3A+0%3Cbr+%2F%3E%3Cbr%3E%3Cb%3EHTTP+output%3A%3C%2Fb%3E%3Cbr%3E' </script>

This is the URL I'm using in the job:
/usr/bin/php /home/ourdomain/public_html/generator/runcrawl.php

I've verified the php file does exist in that location.  What could be the issue?
Re: Cron Job Error
« Reply #2 on: July 11, 2014, 04:28:44 PM »
I tried running it in the browser, all settings set to unlimited and it crashed constantly.  It finally 'completed' after 3 days of constant restarting.

A cron job was recommended but it seems that doesn't work either.

We paid for your software more than a week ago and have yet to be able to use it successfully!
Re: Cron Job Error
« Reply #3 on: July 12, 2014, 02:22:57 PM »
Please try to specify server's IP address in generator configuraiton.
Re: Cron Job Error
« Reply #4 on: July 13, 2014, 05:44:02 PM »
Where do I specify the server's IP address?
Re: Cron Job Error
« Reply #5 on: July 14, 2014, 02:42:48 PM »
On generator configuration page there is a setting named:
Use IP address for crawling:
Re: Cron Job Error
« Reply #6 on: July 14, 2014, 03:14:45 PM »
Ok.  I have done that and attempted to re-run the job manually and it stopped again after a minute.

Can someone please verify our settings?  I'd like to get this resolved today.
Re: Cron Job Error
« Reply #7 on: July 15, 2014, 01:18:05 PM »
Hello,

what is the output you get if running generator manually in command line via ssh?
Re: Cron Job Error
« Reply #8 on: July 15, 2014, 03:07:15 PM »
How do I do that?  I have Terminal up and running but don't know the syntax I need to use to do what you suggested.

I was trying to run the crawler again in the generator web interface and it stopped after 50 seconds.
Re: Cron Job Error
« Reply #9 on: July 16, 2014, 06:10:06 PM »
You would just enter this in terminal:
/usr/bin/php /home/ourdomain/public_html/generator/runcrawl.php
Re: Cron Job Error
« Reply #10 on: July 16, 2014, 08:13:42 PM »
It returns exactly what I initially posted...

<h4>An error occured: </h4> <script> top.location = 'index.php?op=config&errmsg=%3Cb%3EThere+was+an+error+while+retrieving+the+URL+specified%3A%3C%2Fb%3E+http%3A%2F%2Fdomain.com%2F%3Cbr%3E%3Cb%3EHTTP+Code%3A%3C%2Fb%3E%3Cbr%3E%3Cbr%3E%3Cb%3EHTTP+headers%3A%3C%2Fb%3E%3Cbr%3Ex_csize%3A+0%3Cbr+%2F%3E%3Cbr%3E%3Cb%3EHTTP+output%3A%3C%2Fb%3E%3Cbr%3E' </script>
Re: Cron Job Error
« Reply #11 on: July 17, 2014, 10:40:58 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: Cron Job Error
« Reply #12 on: July 17, 2014, 03:06:08 PM »
I just emailed you the info.  Thanks.
Re: Cron Job Error
« Reply #13 on: July 21, 2014, 05:09:33 PM »
Have you figured out yet why we are having issues?  Need to get this resolved and working.  Thanks.