Free Online
Sitemap Generator
Unlimited
Sitemap Generator
About Sitemaps
Broken Links
Forum
Testimonials
Tools
Contact
Advanced search
Sitemap Generator Forum
August 30, 2008, 12:27:57 AM
Welcome,
Guest
. Please
login
or
register
.
Did you miss your
activation email?
1 Hour
1 Day
1 Week
1 Month
Forever
Login with username, password and session length
Home
Help
Search
Login
Register
Sitemap software 2.9 released
- Email notifications, html sitemap customizing and more
7341
Posts in
1806
Topics by
Members
Latest Member:
theknownuniverse
Sitemap Generator Forum
>
XML Sitemaps Discussions Category
>
Bug reporting for Standalone Sitemap Generator
>
I can't get the crawler to crawl my entire website
Pages: [
1
]
« previous
next »
Print
Author
Topic: I can't get the crawler to crawl my entire website (Read 6912 times)
matthew
Registered Customer
Newbie
Posts: 6
I can't get the crawler to crawl my entire website
«
on:
December 31, 2006, 04:06:55 PM »
I do not know how many pages I have in the entire site, but when I do a search for a certain category number it isn't showing so I know it is not reaching my entire site.
Anyways to fix this issue?
I have had it on 0 for unlimited still nothing.
Logged
matthew
Registered Customer
Newbie
Posts: 6
Re: I can't get the crawler to crawl my entire website
«
Reply #1 on:
December 31, 2006, 08:11:25 PM »
Update;
What I did was create a sitemap that had every single category for the site, and since then it was able to fully see the site and report it to the xml.
Thanks
Logged
admin
Administrator
Hero Member
Posts: 3073
Re: I can't get the crawler to crawl my entire website
«
Reply #2 on:
January 02, 2007, 09:11:34 PM »
Great!
I confirm that you should have links to all you category pages so that sitemap generator crawler is able to find your pages starting from homepage.
Logged
Oleg Ignatiuk
http://www.xml-sitemaps.com
Pages: [
1
]
Print
« previous
next »
Jump to:
Please select a destination:
-----------------------------
XML Sitemaps Discussions Category
-----------------------------
=> Unlimited PHP Sitemap Generator
=> Bug reporting for Standalone Sitemap Generator
=> Free Online Sitemaps Generator
=> Site maps - General Discussion
Loading...