XML Sitemaps Generator

Author Topic: Bug: Sitemap generator does not follow redirects.  (Read 20578 times)

service16

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Bug: Sitemap generator does not follow redirects.
« on: June 16, 2008, 09:55:06 PM »
The XML Sitemap Generator I have installed will not crawl pages with Apache redirects. Two of the largest sections of my site rely on such redirects.

To recreate, try mapping

[external links are visible to admins only]
[external links are visible to admins only]

If you visit these URLs in the browser, you will see that they point to [external links are visible to admins only] and [external links are visible to admins only] respectively.

Why won't the script honor this? I do not think it is an installation issue because the free sitemap generator will not follow these URLs either. Is there a known workaround for this limitation, or any plans to fix it?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Bug: Sitemap generator does not follow redirects.
« Reply #1 on: June 17, 2008, 09:07:52 PM »
Hello,

sitemap generator IS able to follow 30x redirects, but in your case the landing URL resides on a different domain (forums.domain.com vs www.domain.com) and it cannot be included in the same sitemap as per sitemaps protocol (otherwise google won't accept the sitemap). I'd recommend to create a separate sitemap for your forums subdomain.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

service16

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Bug: Sitemap generator does not follow redirects.
« Reply #2 on: June 18, 2008, 01:52:44 PM »
Okay. What about the wiki? It actually uses an Apache alias.

service16

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Bug: Sitemap generator does not follow redirects.
« Reply #3 on: June 18, 2008, 02:05:19 PM »
[external links are visible to admins only]
Okay. What about the wiki? It actually uses an Apache alias.

I've just noticed that [external links are visible to admins only] can be mapped by the free sitemap generator but not the standalone one.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Bug: Sitemap generator does not follow redirects.
« Reply #4 on: June 19, 2008, 01:47:09 AM »
Does it work correctly if you specify forexpedia/Main_Page as the link?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

service16

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Bug: Sitemap generator does not follow redirects.
« Reply #5 on: June 25, 2008, 01:42:42 PM »
No, crawling /forexpedia/Main_Page does not work.

service16

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Bug: Sitemap generator does not follow redirects.
« Reply #6 on: June 25, 2008, 05:29:19 PM »
I am getting the following error when I crawl /forexpedia/ with default settings:
ed: 0<br>Creating HTML sitemap...PHP Warning:  ksort() expects parameter 1 to be array, null given in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 51

Warning: ksort() expects parameter 1 to be array, null given in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 51
PHP Warning:  Invalid argument supplied for foreach() in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 53

Warning: Invalid argument supplied for foreach() in /var/www/vhosts/babypips/trunk/public_html/generator/pages/class.html-creator.inc.php(2) : eval()'d code on line 53

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Bug: Sitemap generator does not follow redirects.
« Reply #7 on: June 25, 2008, 10:24:13 PM »
Please let me know your generator URL in private message: http://www.xml-sitemaps.com/forum/index.php?action=pm;sa=send;u=1
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2