XML Sitemaps Generator

Author Topic: Block query from being indexed/ crawled  (Read 7430 times)

sales1296

  • Registered Customer
  • Approved member
  • *
  • Posts: 9
Block query from being indexed/ crawled
« on: March 19, 2014, 07:52:53 AM »
Hi,
I want to remove any link that contains a certain query such as ?widget=pin from not being indexed or crawled and added to sitemap. How can i achieve it?

sales1296

  • Registered Customer
  • Approved member
  • *
  • Posts: 9
Re: Block query from being indexed/ crawled
« Reply #1 on: March 19, 2014, 08:02:02 AM »
Can I just add a Disallow: /? to block all the query calls being crawled by this sitemap generator script?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Block query from being indexed/ crawled
« Reply #2 on: March 20, 2014, 10:10:48 AM »
Hello,

yes, that will work.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2