XML Sitemaps Generator

Author Topic: Setting generator to not crawl non-existent Wiki apges  (Read 15506 times)

kstibbe

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Setting generator to not crawl non-existent Wiki apges
« on: June 21, 2009, 02:35:35 PM »
When the generator crawls our site it outputs a lot of non-existent links in our Wiki

For example"
Code: [external links are visible to admins only]
wiki/index.php?title=Donna_Mia&action=edit&redlink=1

/wiki/index.php?title=Talk:Orcus

What I assume I have to do is add part of the overall link into the exclude URL

But adding =edit&redlink=1  or php?title=Talk does not seem to work.


K Stibbe

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Setting generator to not crawl non-existent Wiki apges
« Reply #1 on: June 21, 2009, 03:22:45 PM »
Hello,

try to add this in "Exclude URLs" setting:
Code: [Select]
action=
title=
do not forget to recreate sitemap after that.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

kstibbe

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Setting generator to not crawl non-existent Wiki apges
« Reply #2 on: June 21, 2009, 11:19:00 PM »
Right!

Trying that now!


K. Stibbe

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2