XML Sitemaps Generator

Author Topic: how to not crawl dynamic pages?  (Read 10903 times)

mroyusa

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
how to not crawl dynamic pages?
« on: January 28, 2011, 07:28:33 AM »
How do you not crawl dynamic pages created by website?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: how to not crawl dynamic pages?
« Reply #1 on: January 28, 2011, 10:47:16 AM »
Hello,

you should just enter your homepage link as Starting URL and further dynamic pages will be found by generator crawler as long as they linked somewhere on your site.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

mroyusa

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: how to not crawl dynamic pages?
« Reply #2 on: January 28, 2011, 11:05:20 AM »
My question was to NOT crawl dynamic pages.
[external links are visible to admins only]]=1

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: how to not crawl dynamic pages?
« Reply #3 on: January 28, 2011, 11:18:56 AM »
Sorry, I misunderstood the request. You should add a question mark "?" in "Exclude URLs" setting, and all links with it will be excluded.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

mroyusa

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: how to not crawl dynamic pages?
« Reply #4 on: January 28, 2011, 11:20:43 AM »
Thanks worked perfectly, do I have to buy the standalone version for each site i own?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: how to not crawl dynamic pages?
« Reply #5 on: January 28, 2011, 11:09:09 PM »
You can use the same license for more than one domain as long as you are the owner of those websites: http://www.xml-sitemaps.com/license.html
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2