XML Sitemaps Generator

Author Topic: Exclude URLs  (Read 17594 times)

accounts16

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 11
Exclude URLs
« on: June 18, 2008, 10:09:42 AM »
Hi,

Do not know what to do. Have a news site with options (links) like: prin, send to friend
URLs are like

[external links are visible to admins only]
[external links are visible to admins only]
[external links are visible to admins only]

so a went for Exclude URLs but excluded the numbers (52, 45 and so on) and the end of the URL.

This does not work

What should I do to have those URLSs Excluded?

Should I put * after sit=      (sit=*)  ?

Matt

CallumW

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 13
Re: Exclude URLs
« Reply #1 on: June 18, 2008, 11:54:07 AM »
Hi
Yes, but use a '?' instead if '*'

Heres an example of an exclude list I use on a domain
The SiteGenerator was picking up stuff like:
Code: [external links are visible to admins only]
domain/blog/entry.html
domain/blog/entry.html?review=write

Don't need the review/comment on each page, so I ignore it by adding to the exclude list:
Code: [external links are visible to admins only]
/*review=write
It follows the same protocol as the robots.txt ('?' = wildcard number, '*' = wildcard character)
« Last Edit: June 18, 2008, 12:07:46 PM by CallumW »

CallumW

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 13
Re: Exclude URLs
« Reply #2 on: June 18, 2008, 12:12:29 PM »
More info on robots.txt [external links are visible to admins only]

Code: [external links are visible to admins only]
http://www.robotstxt.org/orig.html

accounts16

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 11
Re: Exclude URLs
« Reply #3 on: June 18, 2008, 01:32:21 PM »
Thank you, I'll give it a go and let you know

accounts16

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 11
Re: Exclude URLs
« Reply #4 on: June 18, 2008, 01:47:06 PM »
[external links are visible to admins only]
More info on robots.txt [external links are visible to admins only]

Code: [external links are visible to admins only]
http://www.robotstxt.org/orig.html

Thx for inf.

Q. In Exclude URLs do I go h t t p : // www.... and so on OR local path i.e. modules.php?name=News&new_topic=?&pagenum=?

Matt
« Last Edit: June 18, 2008, 01:49:06 PM by accounts16 »

CallumW

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 13
Re: Exclude URLs
« Reply #5 on: June 18, 2008, 02:15:49 PM »
Just the local path as per my exclude example  ;)

accounts16

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 11
Re: Exclude URLs
« Reply #6 on: June 18, 2008, 09:39:13 PM »
[external links are visible to admins only]
Just the local path as per my exclude example  ;)

Hi,

Eh, I am lost.

The URL goes:
h t t p : / / www. domain/ modules.php?name=News&file=friend&op=FriendSend&sid=21378

I removed h t t p : / / www. domain / - did not help.

Wold you rewrite this url thay way it should work, please.

Matt

CallumW

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 13
Re: Exclude URLs
« Reply #7 on: June 19, 2008, 12:06:54 AM »
Code: [external links are visible to admins only]
/*sid=?
if the sid includes chars, not just numbers then do
Code: [external links are visible to admins only]
/*sid=*

All subpages begin / afer the domain
the '*' means anything to the left of your static text 'sid='
The '?' means any number after (or '*' any character after)

;)
« Last Edit: June 19, 2008, 12:11:11 AM by CallumW »

accounts16

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 11
Re: Exclude URLs
« Reply #8 on: June 19, 2008, 07:35:16 PM »
Thank you, got it  :)

IF anyone what to see the list of those that wokr on my site here it is:

/*sid=?
/*sid=*
/*quote=?
/*quote=*
/*pagenum=?
/*pagenum=*
/*ads=?
/*ads=*
/*mod=?
/*mod=*
*/?/*,?

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2