how to scan password protected sites
« on: May 25, 2009, 02:14:32 PM »
Hi
I have a site for members only.
after you type the url of my site you have to insert login details (.htaccess)
How can I scan it

10x
Re: how to scan password protected sites
« Reply #1 on: May 25, 2009, 11:03:57 PM »
Hello,

you should allow accessing your website without login/password, since even if you will create a sitemap, Google will still NOT index your pages if thir bot is unable to open your pages.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: how to scan password protected sites
« Reply #2 on: February 13, 2010, 10:53:32 PM »
I have same issue for www.rolicitatii.ro
Only few pages have free access, all others are under user/password access.

Is it possible to provide the master user/password to your script so it can index the pages?
Re: how to scan password protected sites
« Reply #3 on: February 14, 2010, 07:30:39 PM »
Please check the post above - even if you will include those links in sitemap, they still will NOT be indexed by search engines and their both will not be able to open them.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.