Toggle navigation
PRO Sitemaps
Standalone Generator
About Sitemaps
News
SEO Tools
Sitemap Generator Forum
Guest
Login
Register
Menu
Home
Help
Search
Login
Register
XML Sitemaps Discussions Category
/
Unlimited PHP Sitemap Generator
/
Does not crawl all the pages
On Page SEO Checker:
Get a list of improvements for your website for free in less than 5 minutes!
« previous
next »
Pages:
1
wilf86
2
Does not crawl all the pages
«
on:
December 17, 2015, 05:31:17 AM »
We have CMS website (developed using DotNetNuke). Whenever we run the crawler it generates sitemap.xml for 500+ pages.
We expect the pages to be more than 9000+
What configuration should be done, please help.
Logged
XML-Sitemaps Support
11781
Re: Does not crawl all the pages
«
Reply #1 on:
December 17, 2015, 06:24:35 AM »
Hello,
could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
Logged
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message
SEM and SEO Reports, more than 45M domains
: The world's leading Competitive Intelligence Tool for digital marketing.
wilf86
2
Re: Does not crawl all the pages
«
Reply #2 on:
December 17, 2015, 07:39:24 AM »
example url
[ External links are visible to forum administrators only ]
We are using standalone sitemap generator configured in our server. using the credentials we login in and then go to Crawling tab (attached screen grab) and click run
starting from home page
1. [ External links are visible to forum administrators only ]
2. Click on Get Ideas from the top menu
3. In the find - select make -> Porsche , model -> Cayenne then click GO
4. Click on the first picture AudioMobile will reach you to the above page.
Logged
XML-Sitemaps Support
11781
Re: Does not crawl all the pages
«
Reply #3 on:
December 18, 2015, 07:12:04 AM »
Hello,
there must be a way to reach the pages by clicking links, so that crawler bot can find them. In this case it's required submitting the form (selecting item from dropdown list) hence it's not visible to a bot.
Logged
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message
SEM and SEO Reports, more than 45M domains
: The world's leading Competitive Intelligence Tool for digital marketing.
Pages:
1
« previous
next »