XML Sitemaps Generator

Author Topic: Exclude url in wordpress and others  (Read 9034 times)

pinkstarfruit

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 40
Exclude url in wordpress and others
« on: January 29, 2012, 03:27:26 PM »
Hello!

1.
What is the excluded urls in wordpress since the there is no settings?

2. If i want exclude domain.com/t/ but not domain.com/t/hello
how do i set that?


changing this setting will automatically prepopulate the options below with preset data
Exclude URLs:

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Exclude url in wordpress and others
« Reply #1 on: January 30, 2012, 12:10:02 PM »
Hello,

for wordpress it's recommended to exclude:
Code: [Select]
trackbackdo not parse:
Code: [Select]
rss
feed
tag/

2. You can use this:
Code: [Select]
^t*/$
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

pinkstarfruit

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 40
Re: Exclude url in wordpress and others
« Reply #2 on: February 27, 2012, 03:17:00 AM »
Hello, should i use for example the [external links are visible to admins only] or can i just put rss?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Exclude url in wordpress and others
« Reply #3 on: February 27, 2012, 06:13:38 AM »
Just "rss".
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

pinkstarfruit

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 40
Re: Exclude url in wordpress and others
« Reply #4 on: April 01, 2012, 07:41:06 AM »
Will this make the code not crawl the /v/ but crawl the html links in /t/ but nothing else

exclude:

/video/t/*.html$
/video/v/

parse:

/video/t/*.html$
/video/v/

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Exclude url in wordpress and others
« Reply #5 on: April 02, 2012, 12:35:06 PM »
Anything that matches the "Exclude URLs" will not be crawled or added in sitemap.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

pinkstarfruit

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 40
Re: Exclude url in wordpress and others
« Reply #6 on: April 03, 2012, 04:28:10 PM »
Ok i am trying to include the LINKS but the problem is the script generator start crawling the whole YOUTUBE. So is this correct? You can check here for example bangkokevents.org but this is in root.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Exclude url in wordpress and others
« Reply #7 on: April 03, 2012, 09:02:31 PM »
Not sure I understand correctly what you mean, can you rephrase it?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

pinkstarfruit

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 40
Re: Exclude url in wordpress and others
« Reply #8 on: April 04, 2012, 12:05:39 AM »
This is a video script. xml-sitemaps make a sitemap for YOUTUBE since my content is api from YOUTUBE. I need to stop it from crawling ALL YOUTUBE.com just the links on the left side of the page and not any other VIDEO in search.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Exclude url in wordpress and others
« Reply #9 on: April 05, 2012, 09:57:03 AM »
Please PM me specific example URLs so that I can check it.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2