need help tweaking
« on: June 27, 2008, 04:39:32 PM »
i'm trying to get the sitemap generator to log all links for my osCommerce website. by "all links" i mean all the categorical links, as well as all the product links and nothing more. right now what the generator is doing is going through everything, including all the buy it now links, review links, etc. How do I exclude those? What depth link am i looking at?

URL: [ External links are visible to forum administrators only ]
Re: need help tweaking
« Reply #1 on: June 27, 2008, 11:12:41 PM »
Hello,

you should use "Exclude URLs" option to avoid crawling of those pages, here is a good list for osCommerce: https://www.xml-sitemaps.com/forum/index.php/topic,1241.html
Re: need help tweaking
« Reply #2 on: June 27, 2008, 11:20:59 PM »
Hello,

you should use "Exclude URLs" option to avoid crawling of those pages, here is a good list for osCommerce: https://www.xml-sitemaps.com/forum/index.php/topic,1241.html

awesome thanks. i'll give it a shot and let u know :)
« Last Edit: June 27, 2008, 11:29:01 PM by tnetx »
Re: need help tweaking
« Reply #3 on: August 15, 2008, 07:17:14 PM »
well it was working but now it seems to be getting timed out again. it stopped at 7000 pages scanned with 15k more left to go.