XML Sitemaps Generator

    Advanced search
Sitemap Generator Forum
July 23, 2008, 10:10:19 PM
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
   Home   Help Search Login Register  
Sitemap software 2.9 released - Email notifications, html sitemap customizing and more
6867 Posts in 1688 Topics by Members
Latest Member: tonchanluong
Pages: [1]
  Print  
Author Topic: Can generator be configured to index links following one script multiple pages?  (Read 2547 times)
orders34
Registered Customer
Newbie
*
Posts: 4


View Profile
« on: January 20, 2008, 08:26:28 PM »

Hello,

I have a phpbb forum with 10K+ topics that I would like to index (urls are static format not dynamic)

I have created a script that lists links for those topics at 1000 per page

Assuming that url format for the script is [external links are visible to admins only]
and at the bottom of the first listall.php page is a link to the next liastall.php page (such as [external links are visible to admins only]) to get to the next 1000 topics links, and so on

My question is: is it possible to configure the generator to only traverse and index links shown on this script pages (i.e. visit and index: listall.php, listall.php?page=2, listall.php?page=3, etc)?
If yes, what configuration to set for that?

Thanks for any tips
Logged
admin
Administrator
Hero Member
*****
Posts: 2864


View Profile
« Reply #1 on: January 20, 2008, 10:01:04 PM »

Hello,

assuming that you have "viewtopic.php?t=X" links on those pages, you can add "viewtopic.php" into "Do not parse" option. In this case the URLs will still be included in sitemap, but generator won't crawl them.
Logged

Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.5 | SMF © 2006, Simple Machines LLC Valid XHTML 1.0! Valid CSS!