Free Online
Sitemap Generator
Unlimited
Sitemap Generator
Online
PRO
Service
About Sitemaps
Forum
Testimonials
Tools
Contact
Welcome,
Guest
. Please
login
or
register
.
Did you miss your
activation email
?
1 Hour
1 Day
1 Week
1 Month
Forever
Login with username, password and session length
News:
Sitemap software 5.0 released
- Video Sitemaps, News Sitemaps and more!
Home
Help
Search
Login
Register
Sitemap Generator Forum
»
XML Sitemaps Discussions Category
»
Bug reporting for Standalone Sitemap Generator
»
I can't get the crawler to crawl my entire website
« previous
next »
Print
Pages: [
1
]
Author
Topic: I can't get the crawler to crawl my entire website (Read 16266 times)
matthew
Registered Customer
Approved member
Posts: 6
I can't get the crawler to crawl my entire website
«
on:
December 31, 2006, 04:06:55 PM »
I do not know how many pages I have in the entire site, but when I do a search for a certain category number it isn't showing so I know it is not reaching my entire site.
Anyways to fix this issue?
I have had it on 0 for unlimited still nothing.
Logged
matthew
Registered Customer
Approved member
Posts: 6
Re: I can't get the crawler to crawl my entire website
«
Reply #1 on:
December 31, 2006, 08:11:25 PM »
Update;
What I did was create a sitemap that had every single category for the site, and since then it was able to fully see the site and report it to the xml.
Thanks
Logged
XML-Sitemaps Support
Administrator
Hero Member
Posts: 8270
Re: I can't get the crawler to crawl my entire website
«
Reply #2 on:
January 02, 2007, 09:11:34 PM »
Great!
I confirm that you should have links to all you category pages so that sitemap generator crawler is able to find your pages starting from homepage.
Logged
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message
For maximum exposure and traffic for your web site check out our
additional SEO Services
.
Print
Pages: [
1
]
« previous
next »
Sitemap Generator Forum
»
XML Sitemaps Discussions Category
»
Bug reporting for Standalone Sitemap Generator
»
I can't get the crawler to crawl my entire website
SMF 2.0.2
|
SMF © 2011
,
Simple Machines
XHTML
RSS
WAP2