Bug: Sitemap generator does not follow redirects.
« on: June 16, 2008, 10:55:06 PM »
The XML Sitemap Generator I have installed will not crawl pages with Apache redirects. Two of the largest sections of my site rely on such redirects.

To recreate, try mapping

http://www.babypips.com/forums
http://www.babypips.com/forexpedia

If you visit these URLs in the browser, you will see that they point to http://forums.babypips.com/ and http://www.babypips.com/forexpedia/Main_Page respectively.

Why won't the script honor this? I do not think it is an installation issue because the free sitemap generator will not follow these URLs either. Is there a known workaround for this limitation, or any plans to fix it?
Re: Bug: Sitemap generator does not follow redirects.
« Reply #1 on: June 17, 2008, 10:07:52 PM »
Hello,

sitemap generator IS able to follow 30x redirects, but in your case the landing URL resides on a different domain (forums.domain.com vs www.domain.com) and it cannot be included in the same sitemap as per sitemaps protocol (otherwise google won't accept the sitemap). I'd recommend to create a separate sitemap for your forums subdomain.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Bug: Sitemap generator does not follow redirects.
« Reply #2 on: June 18, 2008, 02:52:44 PM »
Okay. What about the wiki? It actually uses an Apache alias.
Re: Bug: Sitemap generator does not follow redirects.
« Reply #3 on: June 18, 2008, 03:05:19 PM »
Okay. What about the wiki? It actually uses an Apache alias.

I've just noticed that http://www.babypips.com/forexpedia can be mapped by the free sitemap generator but not the standalone one.
Re: Bug: Sitemap generator does not follow redirects.
« Reply #4 on: June 19, 2008, 02:47:09 AM »
Does it work correctly if you specify forexpedia/Main_Page as the link?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: Bug: Sitemap generator does not follow redirects.
« Reply #5 on: June 25, 2008, 02:42:42 PM »
No, crawling /forexpedia/Main_Page does not work.
Re: Bug: Sitemap generator does not follow redirects.
« Reply #6 on: June 25, 2008, 06:29:19 PM »
I am getting the following error when I crawl /forexpedia/ with default settings:
ed: 0<br>Creating HTML sitemap...PHP Warning:  ksort() expects parameter 1 to be array, null given in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 51

Warning: ksort() expects parameter 1 to be array, null given in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 51
PHP Warning:  Invalid argument supplied for foreach() in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 53

Warning: Invalid argument supplied for foreach() in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 53
Re: Bug: Sitemap generator does not follow redirects.
« Reply #7 on: June 25, 2008, 11:24:13 PM »
Please let me know your generator URL in private message: http://www.xml-sitemaps.com/forum/index.php?action=pm;sa=send;u=1
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.