I only want canonical url's in my sitemap - Please Help
« on: September 05, 2013, 06:22:46 PM »
I am running the latest version of the sitemap generator.

Here is my issue. My website has many pages with paging added. For example.
www.myurl.com/city/yourcity/   
The above is my "canonical" url

But then many pages I will have paging like this.
www.myurl.com/city/yourcity/?page=2
www.myurl.com/city/yourcity/?page=3

and so on. The issue is I do not want to include the sub paging in my sitemap. I only want to display in my sitemap the canonical url like this.
www.myurl.com/city/yourcity/

So in the sitemap admin page if I exclude the variable (/?) It will take out all the sub pages like I want.

But the issue is all the content (products) listed an all those sub pages with paging are excluded because the crawler will not crawl the paging because I am excluding that variable.

How can I tell the crawler to not include all those sub pages with the paging but DO include all the products on those sub pages??? I have tried everything I can to work around but no luck.

Any help would be appreciated!
Thanks
Re: I only want canonical url's in my sitemap - Please Help
« Reply #1 on: September 08, 2013, 08:16:17 AM »
Hello,

you can add robots meta tag on those pages:
<meta name="robots" content="noindex,follow" />

i.e., it will follow all links form those pages, but will not index pages themselves.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: I only want canonical url's in my sitemap - Please Help
« Reply #2 on: September 18, 2013, 06:24:47 PM »
you mean the sitemap crawler???
Re: I only want canonical url's in my sitemap - Please Help
« Reply #3 on: September 23, 2013, 10:50:31 PM »
The tag should be added on your website pages.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.