v2.9 fresh install on linux dedicated server with xeon, 4gb server ram, scsi drive... lot's of resources available for it to run.  Crawl gives this below and just sits there for as long as I let it.  It will crawl for maybe 15 or 20 minutes and then just stops.  I've tried executing through the shell with the same result where it just stops after 15 to 20 minutes.  The error info is posted below.  Any thoughts on what the issue could be?

php.ini settings:
max_execution_time = 3600
max_input_time = 960
memory_limit = 1024M

Links depth: 1
Current page: products/
Pages added to sitemap: 40
Pages scanned: 40 (1,296.1 KB)
Pages left: 35 (+ 1207 queued for the next depth level)
Time passed: 0:42
Time left: 0:37
Memory usage: 1,087.3 Kb

Warning: preg_match() [function.preg-match]: Compilation failed: (*VERB) not recognized at offset 11 in /home/server/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 114

Warning: preg_match() [function.preg-match]: Compilation failed: (*VERB) not recognized at offset 11 in /home/server/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 120

Warning: preg_match() [function.preg-match]: Compilation failed: (*VERB) not recognized at offset 11 in /home/server/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 202

Warning: preg_match() [function.preg-match]: Compilation failed: (*VERB) not recognized at offset 11 in /home/server/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 202

Warning: preg_match() [function.preg-match]: Compilation failed: (*VERB) not recognized at offset 11 in /home/server/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 202

Warning: preg_match() [function.preg-match]: Compilation failed: (*VERB) not recognized at offset 11 in /home/server/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 202
Re: Warning: preg_match() [function.preg-match]: Compilation failed:
« Reply #1 on: June 17, 2008, 10:01:54 PM »
Hello,

did you modify any settings in sitemap generator config or there are default options used?
Re: Warning: preg_match() [function.preg-match]: Compilation failed:
« Reply #2 on: June 18, 2008, 03:09:13 PM »
Hello,

did you modify any settings in sitemap generator config or there are default options used?

Cut and paste from the config.inc.php.  Hope this helps.

<?php
$grab_parameters = array(
'xs_inc_skip' => '\\.(pdf|doc|txt|rtf)',
'xs_exc_skip' => '\\.(zip|m4v|rar|tar|bz2|tgz|exe|gif|jpg|png|class|jar|mpeg|mpg|mp3|wav|mp4|avi|wmv|gz|mov|mid|ra|ram)',
'xs_proto_skip' => '(\\#|mms:|mailto:|https:|javascript:|ftp:|news:|aim:)',
'xs_exec_time' => '0',
'xs_cache' => '',
'xs_max_pages' => '0',
'xs_initurl' => '[ External links are visible to forum administrators only ].*****.com',
'xs_freq' => 'daily',
'xs_lastmod' => '1',
'xs_lastmodtime' => '2005-06-30 19:35:14',
'xs_priority' => '1.0',
'xs_descpriority' => '0.8',
'xs_autopriority' => '1',
'xs_smname' => '/home/website/public_html/sitemap.xml',
'xs_smurl' => '[ External links are visible to forum administrators only ].*****.com/sitemap.xml',
'xs_gping' => '1',
'xs_yping' => '1',
'xs_makehtml' => '1',
'xs_maketxt' => '1',
'xs_makeror' => '1',
'xs_makebase' => '0',
'xs_compress' => '1',
'xs_excl_urls' => '****list removed*****',
'xs_notconfigured' => '0',
'xs_login' => '*****',
'xs_password' => '*****',
'xs_savestate_time' => '180',
'xs_ipconnection' => '',
'xs_portconnection' => '',
'xs_sm_size' => '40000',
'xs_sm_text_filename' => '',
'xs_sm_text_url' => '',
'xs_cleanurls' => '',
'xs_usecurl' => '0',
'xs_robotstxt' => '1',
'xs_dumptype' => 'serialize',
'xs_cleanpar' => 'PHPSESSID|sid|osCsid',
'xs_chlogorder' => 'asc',
'xs_exclude_check' => '1',
'xs_dateformat' => 'Y, F j',
'xs_allow_httpcode' => '',
'xs_chlog' => '0',
'xs_htmlname' => '/home/website/public_html/sitemap.html',
'xs_htmlpart' => '1000',
'htmlurl' => '[ External links are visible to forum administrators only ].*****.com/sitemap.html',
'xs_max_depth' => '0',
'xs_memlimit' => '0',
'xs_delay_req' => '',
'xs_delay_ms' => '',
'xs_incl_urls' => '*****list removed*****',
'xs_incl_only' => '',
'xs_ind_attr' => '',
'xs_email' => '*****@*****.com',
'xs_metadesc' => '1',);
?>
Re: Warning: preg_match() [function.preg-match]: Compilation failed:
« Reply #3 on: June 19, 2008, 02:35:59 AM »
The issue seems to be related to exclusion options you have defined (you didn't include them in your post), please try to empty that option.
Re: Warning: preg_match() [function.preg-match]: Compilation failed:
« Reply #4 on: June 19, 2008, 03:48:29 AM »
The issue seems to be related to exclusion options you have defined (you didn't include them in your post), please try to empty that option.

OK, I have a very weird result for you.

I emptied the exclusion lists and ran the script again.  It was running fine and about 20 minutes into the run, our website's home page loaded into a frame of the crawling tab of the sitemap generator.  It's like it just ran out of memory and upon updating the crawling screen it just loaded the website instead in the frame.  When I hit the refresh button this is what I got:

"Continue the interrupted session (2008-06-18 21:30:25, URLs added: 349, estimated URLs left: 6116)"

The interrupted session will not start the crawl again.

More server information:
We are running FastCGI, PHP v5.2.6, MySQL 5.0.45, and Apache 2.2.9 on a Linuxbox. 

Should we try adding a memory_limit tag to any PHP file?  Is PHP 5.2.6 OK?  Any other options or considerations?
Re: Warning: preg_match() [function.preg-match]: Compilation failed:
« Reply #5 on: June 19, 2008, 04:43:22 PM »
Yes, it might be a memory_limit problem, try to increase this setting.
Sitemap Generator is compatible both with PHP4.x and PHP5.x versions.