XML Sitemaps Generator

Author Topic: I only want canonical url's in my sitemap - Please Help  (Read 10001 times)

robbie1

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
I only want canonical url's in my sitemap - Please Help
« on: September 05, 2013, 05:22:46 PM »
I am running the latest version of the sitemap generator.

Here is my issue. My website has many pages with paging added. For example.
[external links are visible to admins only]   
The above is my "canonical" url

But then many pages I will have paging like this.
[external links are visible to admins only]
[external links are visible to admins only]

and so on. The issue is I do not want to include the sub paging in my sitemap. I only want to display in my sitemap the canonical url like this.
[external links are visible to admins only]

So in the sitemap admin page if I exclude the variable (/?) It will take out all the sub pages like I want.

But the issue is all the content (products) listed an all those sub pages with paging are excluded because the crawler will not crawl the paging because I am excluding that variable.

How can I tell the crawler to not include all those sub pages with the paging but DO include all the products on those sub pages??? I have tried everything I can to work around but no luck.

Any help would be appreciated!
Thanks

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: I only want canonical url's in my sitemap - Please Help
« Reply #1 on: September 08, 2013, 07:16:17 AM »
Hello,

you can add robots meta tag on those pages:
<meta name="robots" content="noindex,follow" />

i.e., it will follow all links form those pages, but will not index pages themselves.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

robbie1

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Re: I only want canonical url's in my sitemap - Please Help
« Reply #2 on: September 18, 2013, 05:24:47 PM »
you mean the sitemap crawler???

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: I only want canonical url's in my sitemap - Please Help
« Reply #3 on: September 23, 2013, 09:50:31 PM »
The tag should be added on your website pages.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2