XML Sitemaps Generator

Author Topic: any way to disallow certain pages  (Read 6976 times)

maclee7

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
any way to disallow certain pages
« on: July 02, 2014, 12:04:43 AM »
Not sure how to explain this properly, but my site map is bringing up all kinds of pages that are not even there… Here is an example:

[external links are visible to admins only]

I am not sure where it is even getting this item from as it no longer exists.

I have set up a cron job to crawl automatically so it shouldn't be picking up on old links. Either way, I don't even understand why it picks up on the ?cat=120 when the actual page doesn't have that at the end. Any help would be greatly appreciated.

These issues are also brinking up 404's on my google analytics and link back to my site map.

Lee

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: any way to disallow certain pages
« Reply #1 on: July 02, 2014, 01:29:49 PM »
Hello,

you can add this in Exlcude URLs setting:
cat=120
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

maclee7

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: any way to disallow certain pages
« Reply #2 on: July 02, 2014, 05:32:29 PM »
Many thanks for your reply. Is there a way to set it up so that all the CAT= results don't show up? This is just one example, but there are many.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: any way to disallow certain pages
« Reply #3 on: July 06, 2014, 07:08:25 AM »
Yes, you would just enter:
cat=
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2