• Welcome to Sitemap Generator Forum.
 

Site went from over 400 pages down to 7

Started by mnw2000, August 17, 2006, 11:50:49 PM

Previous topic - Next topic

mnw2000

I generated a site map for my site [ External links are visible to forum administrators only ] (and [ External links are visible to forum administrators only ]) and it did a excellent job of getting every link (by going down three levels) resulting in over 400 pages.

However, when I attempted to generate a new site map after adding a few new pages, the site map stops at 7 pages (just the top level). The key file is "/webpages.php"  with various arguments such as "?id=794". However, the generator does not create any entries for these links.

Is there something I need to do to make sure it looks down three levels and works with a framed index.html file.

Thanks.

Marc

XML-Sitemaps Support

Hello Marc,

you have the following in robots.txt file:
QuoteDisallow: /webpages/listing.php
that effectively disallows crawling all of your listing pages.