new - crawler is skipping folders - can you tell me why?

[webmaster176]

Hi!

When I run the generator, it crawls more than 1900 files correctly, and then skips a lot more without comment. As far as I can tell there's no difference. In particular, it doesn't seem to see the whole folder scienceforkids/, which is in my root directory.

Can anyone help?

[XML-Sitemaps Support]

Hello,

looks like that section is restricted with your robots.txt

[webmaster176]

Okay, I'm a moron. Thank you so much. I forgot I had restricted it last year when I began working on the new section. I am so grateful to you for pointing that out.

I hate to appear even more moronic, but now I can't seem to log in to the generator on my site. I wrote down the username and password (I thought) but now they don't seem to work.

Karen

[XML-Sitemaps Support]

You can find out your login and password by viewing config.inc.php file via FTP:
    'xs_login' => '',
    'xs_password' => '',