• Welcome to Sitemap Generator Forum.
 

Crawl not picking up pages

Started by sales433, July 15, 2008, 02:39:06 AM

Previous topic - Next topic

sales433

Hi there,

Long time customer, just purchased another license as I couldn't find the download link from one of our other copies.

Anyway, got this issue when the script wont crawl a bunch of our pages properly.

We have the site
/
then some pages like
/afolder/
/bfolder/
/cfolder/
and for some reason  the script will pickup and process all of /bfolder/ and it's child directories, but for some reason it just ads /afolder/ and /cfolder/ to the site map but wont process any of there pages.

We do have some exclusions setup however I did try scanning with those disabled however still didn't help.

Not sure what to do from here....