XML Sitemaps Generator

« previous next »
Pages: [1]

Author Topic: how to scan password protected sites  (Read 9235 times)

ohadziv

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
how to scan password protected sites
« on: May 25, 2009, 01:14:32 PM »
Hi
I have a site for members only.
after you type the url of my site you have to insert login details (.htaccess)
How can I scan it

10x
Logged

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 7985
Re: how to scan password protected sites
« Reply #1 on: May 25, 2009, 10:03:57 PM »
Hello,

you should allow accessing your website without login/password, since even if you will create a sitemap, Google will still NOT index your pages if thir bot is unable to open your pages.
Logged
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

sales499

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Re: how to scan password protected sites
« Reply #2 on: February 13, 2010, 10:53:32 PM »
I have same issue for [external links are visible to admins only]
Only few pages have free access, all others are under user/password access.

Is it possible to provide the master user/password to your script so it can index the pages?
Logged

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 7985
Re: how to scan password protected sites
« Reply #3 on: February 14, 2010, 07:30:39 PM »
Please check the post above - even if you will include those links in sitemap, they still will NOT be indexed by search engines and their both will not be able to open them.
Logged
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Pages: [1]
« previous next »
 

SMF 2.0.2 | SMF © 2011, Simple Machines
XHTML RSS WAP2