• Welcome to Sitemap Generator Forum.
 

Bug: Sitemap generator does not follow redirects.

Started by service16, June 16, 2008, 10:55:06 PM

Previous topic - Next topic

service16

The XML Sitemap Generator I have installed will not crawl pages with Apache redirects. Two of the largest sections of my site rely on such redirects.

To recreate, try mapping

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

If you visit these URLs in the browser, you will see that they point to [ External links are visible to forum administrators only ] and [ External links are visible to forum administrators only ] respectively.

Why won't the script honor this? I do not think it is an installation issue because the free sitemap generator will not follow these URLs either. Is there a known workaround for this limitation, or any plans to fix it?

XML-Sitemaps Support

Hello,

sitemap generator IS able to follow 30x redirects, but in your case the landing URL resides on a different domain (forums.domain.com vs [ External links are visible to logged in users only ]) and it cannot be included in the same sitemap as per sitemaps protocol (otherwise google won't accept the sitemap). I'd recommend to create a separate sitemap for your forums subdomain.

service16

Okay. What about the wiki? It actually uses an Apache alias.

service16

Quote from: service16 on June 18, 2008, 02:52:44 PM
Okay. What about the wiki? It actually uses an Apache alias.

I've just noticed that [ External links are visible to forum administrators only ] can be mapped by the free sitemap generator but not the standalone one.


service16

No, crawling /forexpedia/Main_Page does not work.

service16

I am getting the following error when I crawl /forexpedia/ with default settings:
ed: 0<br>Creating HTML sitemap...PHP Warning:  ksort() expects parameter 1 to be array, null given in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 51

Warning: ksort() expects parameter 1 to be array, null given in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 51
PHP Warning:  Invalid argument supplied for foreach() in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 53

Warning: Invalid argument supplied for foreach() in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 53