XML Sitemaps Generator

Author Topic: how to scan password protected sites  (Read 15555 times)

ohadziv

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
how to scan password protected sites
« on: May 25, 2009, 01:14:32 PM »
Hi
I have a site for members only.
after you type the url of my site you have to insert login details (.htaccess)
How can I scan it

10x

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: how to scan password protected sites
« Reply #1 on: May 25, 2009, 10:03:57 PM »
Hello,

you should allow accessing your website without login/password, since even if you will create a sitemap, Google will still NOT index your pages if thir bot is unable to open your pages.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

sales499

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Re: how to scan password protected sites
« Reply #2 on: February 13, 2010, 10:53:32 PM »
I have same issue for [external links are visible to admins only]
Only few pages have free access, all others are under user/password access.

Is it possible to provide the master user/password to your script so it can index the pages?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: how to scan password protected sites
« Reply #3 on: February 14, 2010, 07:30:39 PM »
Please check the post above - even if you will include those links in sitemap, they still will NOT be indexed by search engines and their both will not be able to open them.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2