vbulletin with CMS doesn't crawl other directories
« on: January 28, 2017, 06:34:51 PM »
I am running a VBulletin 4 forum with CMS on my site. I would like the generator to index my reference directory which is parallel to the forums directory.

With the CMS, the index.php in the root directory is created from the forums. It seems that the generator cannot find it's way back to the root directory when started from the CMS index.php

I seem to have overcome this by using additional starting urls in the Advanced Settings. Unfortunately, it only seems to crawl a few pages in each directory and move on. I would like it to crawl my "reference" directory thoroughly.

Any suggestions?
Re: vbulletin with CMS doesn't crawl other directories
« Reply #1 on: January 29, 2017, 08:20:44 AM »

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?