I have a hierarchical file list.
Concretely, I have a contacts.php file that lists users in my website (every item in the list is a link to a profile.php file), and I want the crawler to include all the user profiles in the sitemap.xml.
So, I want a sitemap.xml like this:
Ok, so I tell it to start crawling from that contacts.php file, and configure it to NOT parse the profile.php file (this file contains links to other files I don't want to include), but the crawler seems to ignore it, because it puts every link it finds inside profile.php.
Finally, I get a sitemap.xml like this:
What am I doing wrong?