Block query from being indexed/ crawled
« on: March 19, 2014, 07:52:53 AM »
Hi,
I want to remove any link that contains a certain query such as ?widget=pin from not being indexed or crawled and added to sitemap. How can i achieve it?
Re: Block query from being indexed/ crawled
« Reply #1 on: March 19, 2014, 08:02:02 AM »
Can I just add a Disallow: /? to block all the query calls being crawled by this sitemap generator script?