Free Online
Sitemap Generator
Unlimited
Sitemap Generator
About Sitemaps
Broken Links
Forum
Testimonials
Tools
Contact
Advanced search
Sitemap Generator Forum
July 19, 2008, 05:01:06 AM
Welcome,
Guest
. Please
login
or
register
.
Did you miss your
activation email?
1 Hour
1 Day
1 Week
1 Month
Forever
Login with username, password and session length
Home
Help
Search
Login
Register
Sitemap software 2.9 released
- Email notifications, html sitemap customizing and more
6804
Posts in
1674
Topics by
Members
Latest Member:
Question Mark
Sitemap Generator Forum
>
XML Sitemaps Discussions Category
>
Site maps - General Discussion
>
crawling problem
Pages: [
1
]
« previous
next »
Print
Author
Topic: crawling problem (Read 3603 times)
casper
Newbie
Posts: 1
crawling problem
«
on:
January 03, 2008, 03:41:10 AM »
Hi,
I had the Standalone XML Sitemap Generator and would like to ask how to fix this problem because every time i run the crawling it generate in the sitemap the 2 different link of that same folder one with index.html and the other one is without index.html, for example this url :
[external links are visible to admins only] and the other one is [external links are visible to admins only]
which is wrong is should only generate only 1 link not 2
THANKS,
CASPER
Logged
admin
Administrator
Hero Member
Posts: 2837
Re: crawling problem
«
Reply #1 on:
January 04, 2008, 12:55:39 AM »
Hello,
you should modify your site to only include one of the links, either "directory/" or "directory/index.html". If you use both of them, Sitemap Generator will find them too.
Logged
Oleg Ignatiuk
http://www.xml-sitemaps.com
info445
Registered Customer
Newbie
Posts: 1
Re: crawling problem
«
Reply #2 on:
February 28, 2008, 02:00:04 PM »
hello,
is there another way? I would hate to have to search my site to find all the occurences.
So is there a way to tell the script to ignore the link without index?
Like accepting only url with .php .html and .htm?
thank you in advance
nicolas
Logged
admin
Administrator
Hero Member
Posts: 2837
Re: crawling problem
«
Reply #3 on:
February 28, 2008, 11:44:00 PM »
That would be the only reliable way to avoid indexing of both URLs, since search engines will be able to find both links anyway, even if you will include only one in sitemap.
Logged
Oleg Ignatiuk
http://www.xml-sitemaps.com
Pages: [
1
]
Print
« previous
next »
Jump to:
Please select a destination:
-----------------------------
XML Sitemaps Discussions Category
-----------------------------
=> Unlimited PHP Sitemap Generator
=> Bug reporting for Standalone Sitemap Generator
=> Free Online Sitemaps Generator
=> Site maps - General Discussion
Loading...