XML Sitemaps Generator

Author Topic: Help!  (Read 23187 times)

lizardlips

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Help!
« on: September 12, 2006, 05:07:50 PM »
I have 100s of pages I do not want crawled. I am having a hard time figuring out how to set this up to work properly. Here are some examples of what I want crawled and below are the some I dont. Please help.

Want crawled:

Base URL/idirectory/inspectors.php?st=va
Base URL/idirectory/inspectors.php?st=md

And all the rest of the states



Dont want crawled

All the listings below exsist for each member of our site. That is 100s Each listing pulls the information out of the database.

Base URL/idirectory/view.php?id=142&page=0&cat=1

Base URL/idirectory/out.php?ID=142

Based URL/idirectory/mail2.php?id=142&cat=1&page=0

Base URL/idirectory/review.php?id=142&cat=1&page=0

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Help!
« Reply #1 on: September 13, 2006, 01:16:26 AM »
Hello,

you can add the following in "Exclude URLs" option:
Quote
view.php
out.php
mail2.php
review.php
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2