XML Sitemaps Generator

Author Topic: Generator gets stuck in a loop  (Read 16127 times)

Robert_Readman

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 34
Generator gets stuck in a loop
« on: May 19, 2009, 09:42:41 AM »
When a site uses relative urls, the generator can get stuck in a loop because it finds pages that don't exist because it ignores the <base href="[external links are visible to admins only]"> tag.

i.e.
you are at the URL "[external links are visible to admins only]"
there are links to just "info.asp" "contact.asp" which do not exist in /cat/sub/

The crawler detects [external links are visible to admins only] and contact.asp as a URL.

I have asked our developers to change "info.asp" to "/info.asp" which is how it should be done for good code, but they argue that <base href="[external links are visible to admins only]"> is valid code.

How can I turn on base url support in XML-Sitemaps?
Due to this issue, the crawler hits the site of 700 odd pages, and finds 90,000+ when running 4 levels deep.

Anyhelp please? other than to fire the developers!?!

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Generator gets stuck in a loop
« Reply #1 on: May 19, 2009, 12:00:15 PM »
Hello,

please try to install sitemap generator v3.0 that has just been released, it has a fix for <base href> included.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

Robert_Readman

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 34
Re: Generator gets stuck in a loop
« Reply #2 on: May 22, 2009, 09:01:00 AM »
Hi, I upgraded to v3, and this issue still occures.

When the sitemap generator looks for the <base href> will it matter if base href is formatted as below...

<base href = "[external links are visible to admins only]">

or does it have to be <base href="[external links are visible to admins only]"> (note no spaces)

Thanks,

Rob.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Generator gets stuck in a loop
« Reply #3 on: May 22, 2009, 04:18:26 PM »
It should be without spaces around "=".
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2