XML Sitemaps Generator

Author Topic: Something I learned about the sitemap Generator and Forum Calendar  (Read 5957 times)

Nwatson99

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 20
  • AR15 Owner and Operator
Folks this is not a negative in my opinion unless you do not want the Calendar indexed, but I found out by watching my Generator what was taking so long, it is the Calendar.

The Generator spent hours upon hours on the calendar portion of my forum, it was unreal and from watching the crawling process it was indexing dates on the calendar that were not even visible to me the owner, staff, members, or guests.

My calendar is setup for 5 year, began in 2013 and not visible after 2018, but the Generator was putting out dates in 2022, so I knew there was a setting or something I overlooked causing the calendar indexing to happen.

Best way to fix if you do not want your calendar indexed is to add this to your robot.txt sheet:
Disallow:/app=calendar/*
Disallow:/calendar/*

If you do not have a robot.txt sheet, you are using a discussion forum and do not want your calendar indexed then turn off your Calendar access to Guests member group.

Nwatson99

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 20
  • AR15 Owner and Operator
Re: Something I learned about the sitemap Generator and Forum Calendar
« Reply #1 on: February 12, 2014, 04:28:23 PM »
Update
Calendar issue dealt with and it removed 2.75 pages of sitemap not having the calendar indexed.
The sitemap dates for the calendar ranged from 1970 to 2022.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2