My robots.txt file is designed to exclude a variety of types of pages from being crawled by various bots.  Is there a way to import my robots.txt into the xmlgenerator, so that it excludes the same types of page?  Specifically, I'd like to exclude those with the following words in the URLs:
and any pages with "embed" in the URL.


sitemap generator should detect robots.txt directives automatically, please let me know your generator URL/login private message to check this.
I emailed you a private message with my URL/login.