XML Sitemaps Generator

Author Topic: How is it finding subdirectories where subdomains are?  (Read 13816 times)

big69

  • Approved member
  • *
  • Posts: 2
How is it finding subdirectories where subdomains are?
« on: January 18, 2009, 08:41:08 PM »

I used xml-sitemaps.com free generator to make a site map of a maindomain.  It finds the directories where my subdomains are and it included all those files in the sitemap. I'd rather not have it do that.  How did xml-sitemaps.com generator even find these subdirectories if I do not currently have any url links within my maindomain to them?  I do have links to my subdomains but the current links to these are by linking them with their subdomain names.   I'd rather it didn't find these subdirectories because I'll make sitemaps of the subdomains separately.

Thanks in advance. :)

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: How is it finding subdirectories where subdomains are?
« Reply #1 on: January 18, 2009, 09:08:42 PM »
Hello,

you can exclude those subfolders from crawling using robots.txt file.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

big69

  • Approved member
  • *
  • Posts: 2
Re: How is it finding subdirectories where subdomains are?
« Reply #2 on: January 18, 2009, 09:39:43 PM »
Okay, Thanks!  That seems simple enough.   While searching I found this: 
[external links are visible to admins only]

Is there any true about google has done what is described there with subdomains?   

Thanks again. 

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2