XML Sitemaps Generator

    Advanced search
Sitemap Generator Forum
October 07, 2008, 10:54:24 AM
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
   Home   Help Search Login Register  
Sitemap software 2.9 released - Email notifications, html sitemap customizing and more
7764 Posts in 1914 Topics by Members
Latest Member: sirkka.keranen
Pages: [1]
  Print  
Author Topic: Can you do a "reverse exclude"?  (Read 3870 times)
per.torstensson
Registered Customer
Newbie
*
Posts: 4


View Profile
« on: November 15, 2007, 12:07:41 PM »

I am having problems getting the xml-sitemap generator to crawl all my site, let me explain:

I have a site full with business listings divided into separate categories I would like to be indexed. Whitin each category these business listings are shown 10 at a time, and if there is more than 10, it obviously get divided into several pages with a page-navigator at the bottom (like with the html-sitemap xml-sitemaps generates). The problem is that this "page counter" only shows 10 page links at a time, and then a next and last link, which if pressed shows another set of ten page links, holding links to 10 business listings each. You get the picture.

What this seems to do for XML-sitemap is this: Say I in this case have +1000 listings in a category, there are only links generated in the sitemap to the first 100. Now, this problem is not entirely consistant cause I have seen xml-generations taking more links into the sitemap (but still not all), however what I am sure of is that a problem only occurs when there are more than 100 business listings within one category.

Is there a way around this problem? In my case I would really like XML-sitemap be dead serious on prioritizing and making sure of following up every url with the string "limit=10" which is a part of every url when a category is divided into multiple pages. Is there a way to do this kind of "reverse exclude" rule? Or is there anything else you would recommend me to do?
Logged
admin
Administrator
Hero Member
*****
Posts: 3259


View Profile
« Reply #1 on: November 16, 2007, 12:17:33 AM »

Hello,

Quote
Is there a way to do this kind of "reverse exclude" rule? Or is there anything else you would recommend me to do?
All links must be included in sitemap, unless they are affected by exclusion option OR pages are excluded with robots meta tag/robots.txt file.
Please let me know your generator URL and an example URL that is not included in sitemap and how that URL can be reached starting from homepage.
Logged

per.torstensson
Registered Customer
Newbie
*
Posts: 4


View Profile
« Reply #2 on: November 16, 2007, 12:03:52 PM »

Thank you for the reply, you will receive a PM with all the details.

I have now revised my earlier claims somewhat. As it seems I was correct only for when the level is deeper than 3.

As it is now, this level of depth works fine, meaning all urls are included, even if there are more than 100:
[external links are visible to admins only] -> Level 1 -> Level 2 -> Level 3 -> 100s of Urls separated by 10 links per page

but what doesn't seem to work is when another level is added:
[external links are visible to admins only] -> Level 1 -> Level 2 -> Level 3 -> Level 4 -> 100 of Urls separate by 10 links per page
Logged
admin
Administrator
Hero Member
*****
Posts: 3259


View Profile
« Reply #3 on: November 17, 2007, 04:44:36 AM »

Hello,

replied to your PM.
Logged

Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.6 | SMF © 2006, Simple Machines LLC Valid XHTML 1.0! Valid CSS!