some pages not being crawled
« on: June 07, 2022, 11:14:46 AM »
We have links to sub directories, but the default index pages in those sub directories are not being added to the site map e.g:

if we have a site [ External links are visible to forum administrators only ] with links to sub directory [ External links are visible to forum administrators only ] (where the sub directory is roles) the index page does not get crawled?

<ul>
      <li><a href="/roles">Roles</a></li>
      <li><a href="/roles/role-alerts">Role Alerts</a></li>
</ul>

So looks like its not able to find the index file (index.php by default) and add to site map.
Re: some pages not being crawled
« Reply #1 on: June 07, 2022, 12:21:49 PM »
This has been solved please ignore