XML Sitemaps Generator

Author Topic: 86,000 pages indexed (:^(  (Read 19391 times)

Goose87109

  • Approved member
  • *
  • Posts: 1
86,000 pages indexed (:^(
« on: February 13, 2008, 05:14:10 PM »
Hey guys,
I tried using the free version. My site only has about 100 active pages at this point. It consist mostly of a calendar, some cool events, a few member profiles and an inactive forum. The problem is when the crawler entered the calendar database, it crawled each month and day back to 1968. This created 1000's of "empty" pages.   ???

I just launched my site in December, so I'd like to filter out any kind of month/day string, while still getting the past and future events (which currently range from abt dec 07 to May 08).

To complicate matters, I'm using a hosted application, with little (ie: NO) access to the server, so installing any kind of php script is out of the question.

Any help would be greatly appreciated!   ;D
'Goose!'

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: 86,000 pages indexed (:^(
« Reply #1 on: February 13, 2008, 09:42:32 PM »
Hello,

I hope that your host allows you to upload robots.txt file, in this case you can exclude your calendart pages form indexing by adding them in robots exclusion list.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2