Crawl not picking up pages
« on: July 15, 2008, 02:39:06 AM »
Hi there,

Long time customer, just purchased another license as I couldn't find the download link from one of our other copies.

Anyway, got this issue when the script wont crawl a bunch of our pages properly.

We have the site
/
then some pages like
/afolder/
/bfolder/
/cfolder/
and for some reason  the script will pickup and process all of /bfolder/ and it's child directories, but for some reason it just ads /afolder/ and /cfolder/ to the site map but wont process any of there pages.

We do have some exclusions setup however I did try scanning with those disabled however still didn't help.

Not sure what to do from here....