Toggle navigation
PRO Sitemaps
Standalone Generator
About Sitemaps
News
SEO Tools
Sitemap Generator Forum
Guest
Login
Register
Menu
Home
Help
Search
Login
Register
XML Sitemaps Discussions Category
/
Site maps - General Discussion
/
Standalone Generator Not Crawling Subdirectories?
Tools for Any SEO Challenge:
Get more traffic to your website with versatile solutions for every step of your SEO journey.
« previous
next »
Pages:
1
andrew50
1
Standalone Generator Not Crawling Subdirectories?
«
on:
August 21, 2021, 06:38:24 PM »
I'm trying to get my standalone php generator to create a sitemap of my website but it's only listing pages from the directory I start it in. I have have various pages organised into subdirectories and I cannot find anywhere that tells me how to make it crawl those directories. All i can find in the documentation is "The crawler will explore only the URLs within the starting directory" but I do not believe this can be true. It crawls and lists images stored in sub directories but not .htm pages. Can you help, I'm probably missing something really simple. Thanks!
Logged
XML-Sitemaps Support
11780
Re: Standalone Generator Not Crawling Subdirectories?
«
Reply #1 on:
August 24, 2021, 05:35:41 AM »
Hello,
there must be a way to reach any page by clicking links, starting from homepage, so that generator's crawler can find them.
Logged
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message
SEM and SEO Reports, more than 45M domains
: The world's leading Competitive Intelligence Tool for digital marketing.
Pages:
1
« previous
next »