Sitemap files with no URLs
« on: August 07, 2011, 09:38:00 AM »
Hi,

My standalone xml-sitemaps is installed at [ External links are visible to forum administrators only ]

The link for the generator is [ External links are visible to forum administrators only ]

I had to put a .htaccess file in the httpdocs folder which has the following so that the folder could be accessed:
RewriteCond %{REQUEST_URI} !/generator

When I create the sitemap – I get a sitemap file which clearly sees that I have 629 urls but it prints the sitemap files without the URLS. See below for an example

Total URLs in this sitemap file: 629
   URL   Last Modified   Change Frequency   Priority
1      2011-08-07T00:52:50+00:00   daily   1.0000
2      2011-08-07T00:52:50+00:00   daily   1.0000

Would you be kind enough to advise where I go from here – I have spent a lot of time on the forum looking for anyone else with a similar problem and could not find anything and I can’t figure it out – all I can think of is that it has something to do with the .htaccess file in the root directory which is required for the site to run.

Here is a copy of the contents of the .htaccess which is in the httpdocs folder above the generator folder if that helps?

<Files .htaccess>
order allow,deny
deny from all
</Files>

<IfModule mod_actions.c>
Action bondi-script /cgi-bin/bondi.fcgi
AddHandler bondi-script .esp
</IfModule>

<IfModule !mod_actions.c>
DirectoryIndex invalidconfig.htm
ErrorDocument 404 "Configuration Error - mod_actions is not installed
ErrorDocument 403 "Configuration Error - mod_actions is not installed
</IfModule>


<IfModule mod_deflate.c>
SetEnv no-gzip dont-vary
RemoveOutputFilter DEFLATE
</IfModule>

<IfModule !mod_cgi.c>
                <IfModule !mod_fcgid.c>           
                DirectoryIndex invalidconfig.htm
                ErrorDocument 404 "Configuration Error - mod_cgi/mod_fcgid not installed
                ErrorDocument 403 "Configuration Error - mod_cgi/mod_fcgid not installed
                </IfModule>
</IfModule>

<IfModule !mod_rewrite.c>
DirectoryIndex invalidconfig.htm
ErrorDocument 404 "Configuration Error - mod_rewrite not installed
ErrorDocument 403 "Configuration Error - mod_rewrite not installed
</IfModule>

<IfModule mod_rewrite.c>

                <IfModule !mod_fcgid.c>
                                <IfModule mod_cgi.c>
                                RewriteEngine on
                                RewriteCond %{REQUEST_URI} !/favicon\.ico
                                RewriteCond %{REQUEST_URI}      !/google[^b]
                                RewriteCond %{REQUEST_URI}      !/formmail
                                RewriteCond %{REQUEST_URI} !\.php$
                                RewriteRule ([^\?]*) cgi-bin/bondi [E=PATH_TRANSLATED:%{DOCUMENT_ROOT}/index.esp]   
                                </IfModule>
                </IfModule>

                <IfModule mod_fcgid.c>
                RewriteEngine On
                RewriteCond %{REQUEST_URI} !/sitemap\.xml
                RewriteCond %{REQUEST_URI} !/ror\.xml
                RewriteCond %{REQUEST_URI} !/sitemap\.html
                RewriteCond %{REQUEST_URI} !/sitemap_images\.xml
                RewriteCond %{REQUEST_URI} !/sitemap_mobile\.html
                RewriteCond %{REQUEST_URI} !/sitemap_video\.xml
                RewriteCond %{REQUEST_URI} !/favicon\.ico
                RewriteCond %{REQUEST_URI} !/google[^b]
                RewriteCond %{REQUEST_URI} !/formmail
                RewriteCond %{REQUEST_URI} !\.php$
                RewriteCond %{REQUEST_URI} !/generator
                RewriteRule . index.esp
                </IfModule>
</IfModule>

Where should I go from here?
Re: Sitemap files with no URLs
« Reply #1 on: August 07, 2011, 01:42:05 PM »
Hello,

I just tried to run generator on your site and created sitemap looks ok to me.
Re: Sitemap files with no URLs
« Reply #2 on: August 07, 2011, 01:48:37 PM »
Hi Oleg,

If you look at the file [ External links are visible to forum administrators only ]

If shows:

XML Sitemap
www.xml-sitemaps.com Total URLs in this sitemap file: 629
 URL Last Modified Change Frequency Priority
1  2011-08-07T09:00:58+00:00 daily 1.0000
2  2011-08-07T09:00:58+00:00 daily 1.0000
3  2011-08-07T09:00:58+00:00 daily 1.0000
4  2011-08-07T09:00:58+00:00 daily 1.0000
5  2011-08-07T09:00:58+00:00 daily 1.0000


There are no URLS
Re: Sitemap files with no URLs
« Reply #3 on: August 08, 2011, 09:00:56 AM »
Hello,

that sitemap file doesn't seem to be produce by our sitemap generator. Perhaps it's overwritten by some other generator or website add-on that you have installed?
Re: Sitemap files with no URLs
« Reply #4 on: August 08, 2011, 10:12:23 AM »
Hi Oleg,

I changed the url.  If you ckick om it from the generator page you will see what I pasted above in my previous post or go here. [ External links are visible to forum administrators only ]
Re: Sitemap files with no URLs
« Reply #5 on: August 09, 2011, 05:37:03 AM »
Any idea's whjy it would not be putting URLS in the sitemap files?
Re: Sitemap files with no URLs
« Reply #7 on: August 11, 2011, 04:15:49 AM »
Hi Oleg,

I don't understand why you can not get to [ External links are visible to forum administrators only ]

Can you get to [ External links are visible to forum administrators only ]  ?

Below is the screenshot - would really appreciate your help
Re: Sitemap files with no URLs
« Reply #8 on: August 13, 2011, 03:04:32 AM »
Hi Oleg,

I know you are a busy man... and appreciate your help.

Have you had a chance to look at this problem ?
Re: Sitemap files with no URLs
« Reply #9 on: August 13, 2011, 09:18:26 AM »
Please try to run generator without "use temporary files to store crawling progress " setting.
Re: Sitemap files with no URLs
« Reply #10 on: August 13, 2011, 01:21:47 PM »
That fixed it!

Thank you Oleg!

Any idea why? Should I change something to get it working without switching that feature off?
Re: Sitemap files with no URLs
« Reply #11 on: August 13, 2011, 04:35:38 PM »
That might happen in case if incorrect page info is stored depending on server configuration. It's definitely not needed in your case though, sitemap generator will work even faster without that option.