XML Sitemaps Generator

    Advanced search
Sitemap Generator Forum
August 28, 2008, 08:38:49 PM
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
   Home   Help Search Login Register  
Sitemap software 2.9 released - Email notifications, html sitemap customizing and more
7312 Posts in 1800 Topics by Members
Latest Member: ciscoleroi
Pages: [1]
  Print  
Author Topic: How to Limit Crawl To Specific URL String  (Read 7526 times)
jhazlewood
Registered Customer
Newbie
*
Posts: 2


View Profile
« on: October 11, 2006, 08:32:15 PM »

How do I set the crawler to only crawl urls on my site that contain the following in the URL string: itemType=CATEGORY in the url string?

Currently the crawler is taking days to get through our site and if I can limit the sitemap to only crawl our extensive combination of categories it should bring the crawl to a more manageable crawl time.

Thanks,
Jason
Logged
admin
Administrator
Hero Member
*****
Posts: 3060


View Profile
« Reply #1 on: October 13, 2006, 01:29:26 AM »

Hello Jason,

currently there is no option for "Crawl only" URLs in sitemap generator, but you can use "Do not parse" option to exclude certain parts of your site.
Logged

Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.5 | SMF © 2006, Simple Machines LLC Valid XHTML 1.0! Valid CSS!