problem generating sitemap !!
« on: August 30, 2014, 09:20:19 PM »
Dear Staff, we have our license assigned for sitemap generator... but we receive ALWAYS an error that block the sitemap generation:

"Links depth: 4
Current page: forum/1645-malaga-spagna-24-09-2010-a-2.html
Pages added to sitemap: 4334
Pages scanned: 6455 (590,247.7 KB)
Pages left: 13603 (+ 44545 queued for the next depth level)
Time passed: 1:40:46
Time left: 3:32:22
Memory usage: 57,346.2 Kb
Resuming the last session (last updated: 2014-08-30 15:31:37)"

Internal Server Error

The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator to inform of the time the error occurred and of anything you might have done that may have caused the error.

More information about this error may be available in the server error log.

Can you help us ???

we are on:
OS    CentOS 6.5 (Final)
Apache web server
PHP 5.4.31 fcgi enabled

ERROR LOG (we hide domain name and path, all is standard and ok):

[Sat Aug 30 22:13:26 2014] [warn] [client IP] mod_fcgid: stderr: PHP Warning:  include(//PATH//generator/pages/page-generator.inc.php): failed to open stream: No such file or directory in //PATH//generator/pages/page-bottom.inc.php on line 105, referer: [ External links are visible to forum administrators only ]
[Sat Aug 30 22:13:26 2014] [warn] [client IP] mod_fcgid: stderr: PHP Warning:  include(): Failed opening '//PATH//generator/pages/page-generator.inc.php' for inclusion (include_path='.:.;pages/;//PATH//generator\\pages') in //PATH//generator/pages/page-bottom.inc.php on line 105, referer: [ External links are visible to forum administrators only ]
[Sat Aug 30 22:13:29 2014] [warn] [client IP] mod_fcgid: stderr: PHP Warning:  include(//PATH//generator/pages/class.templates.inc.php): failed to open stream: No such file or directory in //PATH//generator/pages/page-crawlproc.inc.php on line 212, referer: [ External links are visible to forum administrators only ]
[Sat Aug 30 22:13:29 2014] [warn] [client IP] mod_fcgid: stderr: PHP Warning:  include(): Failed opening '//PATH//generator/pages/class.templates.inc.php' for inclusion (include_path='.:.;pages/;//PATH//generator\\pages') in //PATH//generator/pages/page-crawlproc.inc.php on line 212, referer: [ External links are visible to forum administrators only ]

do you need more infos ??
thank you
Re: problem generating sitemap !!
« Reply #1 on: August 31, 2014, 07:42:41 AM »
Hello,

from the error message it seems that one of the files is missing: generator/pages/page-generator.inc.php
Please reupload all files from generator package.
Re: problem generating sitemap !!
« Reply #2 on: August 31, 2014, 10:18:47 AM »
HEllo, we re-upload all files, same configuration and ... same error:

"Links depth: 3
 Current page: forum/informazioni-utili-sulle-crociere/
 Pages added to sitemap: 505
 Pages scanned: 660 (58,805.0 KB)
 Pages left: 1353 (+ 1527 queued for the next depth level)
 Time passed: 0:08:20
 Time left: 0:17:06
 Memory usage: 6,264.5 Kb
                                                                                             
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator to inform of the time the error occurred and of anything you might have done that may have caused the error.

More information about this error may be available in the server error log."

HERE the ERROR.LOG

[Sun Aug 31 11:13:51 2014] [warn] [client IP] (104)Connection reset by peer: mod_fcgid: error reading data from FastCGI server, referer: domain/generator/index.php?submit=1
[Sun Aug 31 11:13:51 2014] [warn] [client IP] (104)Connection reset by peer: mod_fcgid: ap_pass_brigade failed in handle_request_ipc function, referer: domain/generator/index.php?submit=1

Do you need the configuration file ? maybe we set some options wrong ? if yes tell us wich files do you need.

thank you
Re: problem generating sitemap !!
« Reply #3 on: August 31, 2014, 11:36:59 AM »
we try edit php.ini as below:

memory_limit=256M
max_execution_time=9000

no way... always same error:

"Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator to inform of the time the error occurred and of anything you might have done that may have caused the error.

More information about this error may be available in the server error log."

ERROR.LOG

[Sun Aug 31 12:31:13 2014] [warn] [client IP] (104)Connection reset by peer: mod_fcgid: error reading data from FastCGI server, referer: [ External links are visible to forum administrators only ]
[Sun Aug 31 12:31:13 2014] [warn] [client IP] (104)Connection reset by peer: mod_fcgid: ap_pass_brigade failed in handle_request_ipc function, referer: [ External links are visible to forum administrators only ]

do you wanna the link for check the configuration of generator ?

tell us what do you need !!!

thank you, we have to solve this issue !!
Re: problem generating sitemap !!
« Reply #4 on: September 01, 2014, 05:25:38 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: problem generating sitemap !!
« Reply #5 on: September 01, 2014, 02:31:55 PM »
Hello,

please let me know your generator URL/login in private message to check this.

done ! thank you
Re: problem generating sitemap !!
« Reply #6 on: September 02, 2014, 12:35:50 AM »
any news about our problem ?
problem generating sitemap.. AGAIN !!!
« Reply #8 on: September 12, 2014, 02:34:46 PM »
Dear Staff, we have our license assigned for sitemap generator... but after trying many and many times we have not a sitemap YET !!!

Moreover you close our previuous post without solution...

Please support us as paying customers which we are !

You suggested on date September 03, 2014, 07:03:28 PM, to try with this command from shell:

/usr/bin/php //../DOMAIN.TLD/../runcrawl.php

we edit php.ini to 1 GB max memory and 9000 time exec... but nothing to do... we receive this error:
76638 | 16810 | 6,234,774.9 | 13:57:13 | 3:03:38 | 6 | 170,733.3 Kb | 40590 | 52324 | 50008

PHP Fatal error:  Allowed memory size of 268435456 bytes exhausted (tried to allocate 12217716 bytes) in /path../DOMAIN.TLD/../generator/pages/class.utils.inc.php on line 102

[Exit 255]

Why ?

How can we fix and FINALLY make our sitemap ??
Please....

Thank you. :-\