Standalone Generator not finding all of my pages.

[tyankee]

I just purchased the Standalone Generator and have it working on 2 sites but it is NOT working on 1.  It only pulls the main index.php file and then 1 subdirectory and there are about 4 or 5 plus many root level files.

Here is the link to the generator

[ removed the link for security purposes ]

Please help.

[admin]

Hello,

as I see, you got 4098 pages indexed with last generation.

[sales264]

Yes - but as i stated in my post, the key pages are NOT indexed.  In fact the only page that IS indexed in the root directory is the home page - index.php.   ALL of the other files in the root are NOT indexed.

[admin]

Hello,

please let me know an example URL that is not included in sitemap (in private message).

[sales264]

i just sent you a pm with additional details..  but basically just go to medievalclothing.com and look at the source.   the only links your software pull is the index.php page itself.

[admin]

Hello,

you have the following meta-tag on those  pages:

Code:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

it tells NOT to index the page for search engine bots and sitemap generator automatically excludes them.

[tyankee]

egads..   i can't believe those tags are there..  i must have been drunk one night when i put them in there..

thank you very much.

tony