XML Sitemaps Generator

Author Topic: Excluding Page & Sort URLs  (Read 8497 times)

info1719

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Excluding Page & Sort URLs
« on: May 06, 2011, 09:28:58 PM »
Hi,

I understand how to exclude folders when they come right after the main domain in the URL. For example, if I want to exclude [external links are visible to admins only] I know to exclude /privatecontent. However, how do I exclude crawling content (such as pagination & sorts) that do not easily fall into that category?

For example, I DO want to crawl [external links are visible to admins only]. But I don't want to crawl [external links are visible to admins only] or
[external links are visible to admins only].

How can I exclude URLs that contain /sort/title or sort/created_datetime.

Another example: I do want to crawl [external links are visible to admins only].
But i don't want to crawl [external links are visible to admins only]
or
[external links are visible to admins only]

How can I exclude URLs that contain name_ASC or gender_ASC?

Thank you,
Jason

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Excluding Page & Sort URLs
« Reply #1 on: May 07, 2011, 07:24:58 AM »
Hello,

it can be achieved by adding this in "Exclude URLs" setting:
Code: [Select]
sort/
_ASC
that will remove all links that have that included as a substring.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2