XML Sitemaps Generator

Author Topic: Crawl not picking up pages  (Read 15975 times)


  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Crawl not picking up pages
« on: July 15, 2008, 02:39:06 AM »
Hi there,

Long time customer, just purchased another license as I couldn't find the download link from one of our other copies.

Anyway, got this issue when the script wont crawl a bunch of our pages properly.

We have the site
then some pages like
and for some reason  the script will pickup and process all of /bfolder/ and it's child directories, but for some reason it just ads /afolder/ and /cfolder/ to the site map but wont process any of there pages.

We do have some exclusions setup however I did try scanning with those disabled however still didn't help.

Not sure what to do from here....

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10916
Re: Crawl not picking up pages
« Reply #1 on: July 16, 2008, 03:08:38 AM »

replied to your PM.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.


SMF 2.0.14 | SMF © 2017, Simple Machines