afther installing 7.2 no run completed
« on: March 15, 2017, 08:12:43 AM »
Hy

Afther installing version 7.2 no run completed.
I think all the settings are correct, 7.1 worked?

ERR_INCOMPLETE_CHUNKED_ENCODING

Please help

Thanks 

Bas
Re: afther installing 7.2 no run completed
« Reply #1 on: March 15, 2017, 05:25:05 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: afther installing 7.2 no run completed
« Reply #2 on: April 04, 2017, 03:20:27 AM »
Somewhat similar issue. Cron job is present but after the upgrade no automatic crawling is happening since the upgrading.
Re: afther installing 7.2 no run completed
« Reply #4 on: April 04, 2017, 12:59:51 PM »
Let me re-enable the email notification after I get home from work. I stopped the email notification since it has been running smooth for several years.
Re: afther installing 7.2 no run completed
« Reply #5 on: April 04, 2017, 07:18:32 PM »
Links depth: 4
Current page: tag/index.php?tc=1&tag=reanimeren%20ja%20of%20nee
Pages added to sitemap: 454
Pages scanned: 480 (25,167.3 KB)
Pages left: 25 (+ 601 queued for the next depth level)
Time passed: 0:03:36
Time left: 0:00:11
Memory usage: 3,464.3 Kb
Resuming the last session (last updated: 2017-03-26 18:16:16)
Fatal error: Maximum execution time of 120 seconds exceeded in /www/dataace/eerstehulp/eerstehulp/generator/pages/class.http.inc.php on line 108
Re: afther installing 7.2 no run completed
« Reply #6 on: April 06, 2017, 02:48:01 AM »
Below are the first 2 lines of output when I run the job from the command line in shell access. Not sure what is going on here, the crontab is the same as it has been for a few years, but currently it is not starting to crawl.
I omitted the full path to my file.

htdocs/generator/runcrawl.php: line 1: ?php: No such file or directory
htdocs/generator/runcrawl.php: line 102: syntax error near unexpected token `<'
htdocs/generator/runcrawl.php: line 102: `$ZlXha
90238324sjAaV=920565302;$Etkki94424708ilDIO=736861225;$jnKyv93004048YAdIz=674210                                                                                       778;$IKndU47805658sxjiX=735131746;$SjRYE75606986MpBFw=96504415;$OuSPJ95689785qdj                                                                                       ts=660365940;$MDmRZ66302062IgpiK=486788825;$RlvgD22642417rpbGg=399221556;$uswmi2                                                                                       3363030BEVDj=919760510;$mZPJp13955376jElqZ=350895932;$zAvBd46741908Lcdbg=4326491                                                                                       41;$GILTo48440413TGDgM=503039061;$aCflB77427537PqvdU=229626911;$SQpYz19730834sLa                                                                                       Qx=229188684;$Osfzu61127056VlaoK=187471235;$rNqEF79393472WBIwF=552163974;$IsiBc8                                                                                       3743997weiCu=38215396;$TQUUi16734021DWzBn=476368195;$WIroP46049771bNfCV=39036471                                                                                       6;$wLnAT27621053WoYPW=934243719;$IyRhH73562704NRJTR=452261738;$yVezi40559031CUAv                                                                                       H=217171060;$vBTNZ13121593WsieV=647728718;$CrkNn63032874WzbtQ=133313293;$mFOsU95                                                                                       837769qklIx=898586434;$buJLW39406889KKbEf=444620021;$XDcuT34371305Qxhhn=79898209                                                                                       6;$FdFjM83022708BfGxd=556576967;$qcgYE51274529xPbGn=397585632;$CBWyM97180680YcaA                                                                                       p=677452848;$UqpCE75385781QYZga=247730527;$KYJWc61816376dwbjc=143695250;$gjfcM80                                                                                       515702uedAi=172898180;$UADNu19488586jIciZ=224083156;$KMTwW51689739HFtBy=23417236                                                                                       5;$aRqIS70894720IBqOF=336273039;$rQNEW61966647XpKPr=970596881;$nSzwX24381023ZRAu                                                                                       L=873882993;$iKpQZ88914616hTOrh=868949130;$TsBJP32392888gexvX=411803156;$Nfhqw23                                                                                       765331NxgDD=838284999;$aYpfn60380436NrseH=61792573;$eMXiR12993956zIUCx=270890810                                                                                       ;$ATEoc85874309owXEv=66450182;$WvnJG29910798ROmPX=539366099;$WqzIc62302329FQCTz=                                                                                       671075356;$IvTSM47675087YTKRd=577973127;$bglnz62483927JVCyr=298598501;$qHzHT3951                                                                                       6181ylLCB=178970339;$tBnuS99046445RSpaf=438758331;?><?php $op = $_REQUEST['op']                                                                                        = 'crawlproc'; if(isset($_SERVER['REQUEST_METHOD'])) { echo 'This tool can be ex                                                                                       ecuted in command line mode only'; exit; } $ec75yzgau3Fm1 = true; chdir(dirname(                                                                                       __FILE__)); $_REQUEST['bg'] = true; $_REQUEST['resume'] = true; include './index                                                                                       .php'; '
Re: afther installing 7.2 no run completed
« Reply #7 on: April 06, 2017, 08:04:51 AM »
Hello,

the command line should start with "php " followed by the path and filename runcrawl.php:
php /path/to/generator/runcrawl.php
Re: afther installing 7.2 no run completed
« Reply #8 on: April 07, 2017, 12:19:08 AM »
The cron job is running, output after running from the command line and from email:
X-Powered-By: PHP/4.4.9
Content-type: text/html

Any suggestions are welcome.
Re: afther installing 7.2 no run completed
« Reply #9 on: April 07, 2017, 01:58:44 AM »
Also, from the detailed instrcutions:"When the generator script is running (either with cron or using "Run in background" feature), you will see it's progress state on "Crawling" page."

I don't see this when I manually run the crawler. It used to in the previous version. All I see on the screen is "Please wait. Sitemap generation in progress..." but not:

Links depth
Current page
Pages scanned
Pages left
Time passed
Time left (estimated)
Re: afther installing 7.2 no run completed
« Reply #11 on: April 07, 2017, 02:37:53 PM »
X-Powered-By: PHP/4.4.9
Content-type: text/html

Same as in the email.
Re: afther installing 7.2 no run completed
« Reply #12 on: April 08, 2017, 06:51:31 AM »
Can you provide access details to run generator in command line via the private message?
Re: afther installing 7.2 no run completed
« Reply #13 on: April 08, 2017, 06:59:45 AM »
Sent.
Re: afther installing 7.2 no run completed
« Reply #14 on: April 11, 2017, 03:44:50 AM »
Not sure if you had a chance to look at things, but when I check Use CURL extension for http requests in the configuration I see activity in the ChangeLog tab when the cron runs, so I know something is happening. Unfortunately when that is checked it generates an empty sitemap file. In the analyze tab the following errors are listed: Warning:  ksort() expects parameter 1 to be array, null given in generator/pages/page-analyze.inc.php on line 120
Warning:  Invalid argument supplied for foreach() in generator/pages/page-analyze.inc.php on line 120

(Full path(s) deleted).

When I run it manually from the Crawling tab with the Curl extension checked the job runs fine.

Just trying different things to hopefully get this resolved.