Couple of Issues
« on: April 18, 2008, 04:57:07 PM »
Hi,

1) My site has stopped producing an html sitemap (copy of config file below).  It is producing  URL.TXT, ROR and XML file stored in the proper location.  I have a CRON job set up to run each evening at 11:30pm.
2) The GBase.xlm file is not being stored to the correct directory.  Should be same as sitemap, URL and ROR.
2 ) My sitemaps that are being produced are incomplete.  Not all the files are being index.
3) After I run the stemap manually, I see a WARNINGS page that disappers as soon as I try to scroll through it.  How do I access this warning list to correct he problems?

Thanks.

<?php
$grab_parameters = array(
'xs_inc_skip' => '\\.(pdf|doc|txt|rtf)',
'xs_exc_skip' => '\\.(zip|m4v|rar|tar|bz2|tgz|exe|gif|jpg|png|class|jar|mpeg|mpg|mp3|wav|mp4|avi|wmv|gz|mov|mid|ra|ram)',
'xs_proto_skip' => '(\\#|mms:|mailto:|https:|javascript:|ftp:|news:)',
'xs_exec_time' => '0',
'xs_cache' => '',
'xs_max_pages' => '0',
'xs_initurl' => '[ External links are visible to forum administrators only ]',
'xs_freq' => 'daily',
'xs_lastmod' => '1',
'xs_lastmodtime' => '2005-06-30 19:35:14',
'xs_priority' => '0.5',
'xs_descpriority' => '0.8',
'xs_autopriority' => '1',
'xs_smname' => 'C:\\Program Files\\Telligent\\Community Server 2007/Web/sitemap.xml',
'xs_smurl' => '[ External links are visible to forum administrators only ]',
'xs_gping' => '1',
'xs_yping' => '',
'xs_makehtml' => '1',
'xs_maketxt' => '1',
'xs_makeror' => '1',
'xs_makebase' => '1',
'xs_compress' => '0',
'xs_excl_urls' => 'about.aspx',
'xs_notconfigured' => '0',
'xs_login' => '',
'xs_password' => '',
'xs_savestate_time' => '180',
'xs_ipconnection' => '',
'xs_portconnection' => '',
'xs_sm_size' => '50000',
'xs_sm_text_filename' => 'C:\\Program Files\\Telligent\\Community Server 2007/Web/URLList.txt',
'xs_sm_text_url' => '[ External links are visible to forum administrators only ]',
'xs_cleanurls' => '',
'xs_usecurl' => '0',
'xs_robotstxt' => '1',
'xs_dumptype' => 'serialize',
'xs_cleanpar' => 'PHPSESSID|sid|osCsid',
'xs_chlogorder' => 'asc',
'xs_exclude_check' => '1',
'xs_allow_httpcode' => '',
'xs_chlog' => '1',
'xs_htmlname' => 'C:\\Program Files\\Telligent\\Community Server 2007/Web/sitemap.html',
'xs_htmlpart' => '20000',
'xs_max_depth' => '0',
'xs_delay_req' => '',
'xs_delay_ms' => '',
'xs_incl_urls' => 'about.aspx',
'xs_incl_only' => '',
'xs_ind_attr' => '',
'xs_metadesc' => '0',);
?>

Robot.TXT File

User-Agent: *
Disallow: /web/EC_Reg/
Disallow: /web/blogs/about.aspx
Allow: /
sitemap: [ External links are visible to forum administrators only ]
Re: Couple of Issues
« Reply #1 on: April 18, 2008, 10:10:23 PM »
Hello,

1. You have specified incorrect file name for html sitemap (C:\Program Files\... while your website is stored in C:\Inetpub\...)

2. google base feed is not supported officially.

3. Please PM me an example URL that is not included in sitemap and how it can be reached from homepage.

4. see (1)
Re: Couple of Issues
« Reply #2 on: April 19, 2008, 01:00:06 AM »
Hi,

Below is an example of a URL not being indexed.

[ External links are visible to forum administrators only ]

I do not understand your reference to the Warning I get while I am INSIDE the Generator Interface after I manually run the scan.

Thanks,

Jeff
Re: Couple of Issues
« Reply #3 on: April 20, 2008, 11:07:12 AM »
How that URL can be reached starting from homepage?

The warning message is most likely related to incorrectly defined permissions or sitemap file path (like in your case).