XML Sitemaps Generator

Author Topic: How to prevent sitemap not to craw certain directory.  (Read 9664 times)

augustine.towonsing

  • Approved member
  • *
  • Posts: 1
How to prevent sitemap not to craw certain directory.
« on: November 19, 2011, 06:25:45 PM »
Greeting,
I have a problem with my sitemap which is there certain directory that I don't want it to be mapped such as photo gallery. I have installed the robots text to prevent the directory to be craw for a reason yet the site map somehow don't obey the robots text.

Any idea, I really want to have a clean site map which I only wanted the text pages to be map not images.

So, how exact I could do this? thanks.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: How to prevent sitemap not to craw certain directory.
« Reply #1 on: November 21, 2011, 10:22:23 AM »
Hello,

what  is the URL you want to exclude and your robots.txt content?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2