Sitemap Generator Forum

Hy

Afther installing version 7.2 no run completed.
I think all the settings are correct, 7.1 worked?

ERR_INCOMPLETE_CHUNKED_ENCODING

Please help

Thanks 

Bas

Hello,

please let me know your generator URL/login in private message to check this.

Somewhat similar issue. Cron job is present but after the upgrade no automatic crawling is happening since the upgrading.

What is the content of cron notification email you get?

Let me re-enable the email notification after I get home from work. I stopped the email notification since it has been running smooth for several years.

Links depth: 4
Current page: tag/index.php?tc=1&tag=reanimeren%20ja%20of%20nee
Pages added to sitemap: 454
Pages scanned: 480 (25,167.3 KB)
Pages left: 25 (+ 601 queued for the next depth level)
Time passed: 0:03:36
Time left: 0:00:11
Memory usage: 3,464.3 Kb
Resuming the last session (last updated: 2017-03-26 18:16:16)
Fatal error: Maximum execution time of 120 seconds exceeded in /www/dataace/eerstehulp/eerstehulp/generator/pages/class.http.inc.php on line 108

Below are the first 2 lines of output when I run the job from the command line in shell access. Not sure what is going on here, the crontab is the same as it has been for a few years, but currently it is not starting to crawl.
I omitted the full path to my file.

htdocs/generator/runcrawl.php: line 1: ?php: No such file or directory
htdocs/generator/runcrawl.php: line 102: syntax error near unexpected token `<'
htdocs/generator/runcrawl.php: line 102: `$ZlXha
90238324sjAaV=920565302;$Etkki94424708ilDIO=736861225;$jnKyv93004048YAdIz=674210                                                                                       778;$IKndU47805658sxjiX=735131746;$SjRYE75606986MpBFw=96504415;$OuSPJ95689785qdj                                                                                       ts=660365940;$MDmRZ66302062IgpiK=486788825;$RlvgD22642417rpbGg=399221556;$uswmi2                                                                                       3363030BEVDj=919760510;$mZPJp13955376jElqZ=350895932;$zAvBd46741908Lcdbg=4326491                                                                                       41;$GILTo48440413TGDgM=503039061;$aCflB77427537PqvdU=229626911;$SQpYz19730834sLa                                                                                       Qx=229188684;$Osfzu61127056VlaoK=187471235;$rNqEF79393472WBIwF=552163974;$IsiBc8                                                                                       3743997weiCu=38215396;$TQUUi16734021DWzBn=476368195;$WIroP46049771bNfCV=39036471                                                                                       6;$wLnAT27621053WoYPW=934243719;$IyRhH73562704NRJTR=452261738;$yVezi40559031CUAv                                                                                       H=217171060;$vBTNZ13121593WsieV=647728718;$CrkNn63032874WzbtQ=133313293;$mFOsU95                                                                                       837769qklIx=898586434;$buJLW39406889KKbEf=444620021;$XDcuT34371305Qxhhn=79898209                                                                                       6;$FdFjM83022708BfGxd=556576967;$qcgYE51274529xPbGn=397585632;$CBWyM97180680YcaA                                                                                       p=677452848;$UqpCE75385781QYZga=247730527;$KYJWc61816376dwbjc=143695250;$gjfcM80                                                                                       515702uedAi=172898180;$UADNu19488586jIciZ=224083156;$KMTwW51689739HFtBy=23417236                                                                                       5;$aRqIS70894720IBqOF=336273039;$rQNEW61966647XpKPr=970596881;$nSzwX24381023ZRAu                                                                                       L=873882993;$iKpQZ88914616hTOrh=868949130;$TsBJP32392888gexvX=411803156;$Nfhqw23                                                                                       765331NxgDD=838284999;$aYpfn60380436NrseH=61792573;$eMXiR12993956zIUCx=270890810                                                                                       ;$ATEoc85874309owXEv=66450182;$WvnJG29910798ROmPX=539366099;$WqzIc62302329FQCTz=                                                                                       671075356;$IvTSM47675087YTKRd=577973127;$bglnz62483927JVCyr=298598501;$qHzHT3951                                                                                       6181ylLCB=178970339;$tBnuS99046445RSpaf=438758331;?><?php $op = $_REQUEST['op']                                                                                        = 'crawlproc'; if(isset($_SERVER['REQUEST_METHOD'])) { echo 'This tool can be ex                                                                                       ecuted in command line mode only'; exit; } $ec75yzgau3Fm1 = true; chdir(dirname(                                                                                       __FILE__)); $_REQUEST['bg'] = true; $_REQUEST['resume'] = true; include './index                                                                                       .php'; '

Hello,

the command line should start with "php " followed by the path and filename runcrawl.php:
php /path/to/generator/runcrawl.php

The cron job is running, output after running from the command line and from email:
X-Powered-By: PHP/4.4.9
Content-type: text/html

Any suggestions are welcome.

Also, from the detailed instrcutions:"When the generator script is running (either with cron or using "Run in background" feature), you will see it's progress state on "Crawling" page."

I don't see this when I manually run the crawler. It used to in the previous version. All I see on the screen is "Please wait. Sitemap generation in progress..." but not:

Links depth
Current page
Pages scanned
Pages left
Time passed
Time left (estimated)

What is the output when you run it in command line in shell?

X-Powered-By: PHP/4.4.9
Content-type: text/html

Same as in the email.

Can you provide access details to run generator in command line via the private message?

Sent.

Not sure if you had a chance to look at things, but when I check Use CURL extension for http requests in the configuration I see activity in the ChangeLog tab when the cron runs, so I know something is happening. Unfortunately when that is checked it generates an empty sitemap file. In the analyze tab the following errors are listed: Warning:  ksort() expects parameter 1 to be array, null given in generator/pages/page-analyze.inc.php on line 120
Warning:  Invalid argument supplied for foreach() in generator/pages/page-analyze.inc.php on line 120

(Full path(s) deleted).

When I run it manually from the Crawling tab with the Curl extension checked the job runs fine.

Just trying different things to hopefully get this resolved.