I am running a VBulletin 4 forum with CMS on my site. I would like the generator to index my reference directory which is parallel to the forums directory.
With the CMS, the index.php in the root directory is created from the forums. It seems that the generator cannot find it's way back to the root directory when started from the CMS index.php
I seem to have overcome this by using additional starting urls in the Advanced Settings. Unfortunately, it only seems to crawl a few pages in each directory and move on. I would like it to crawl my "reference" directory thoroughly.