XML Sitemaps Generator

Author Topic: Run crawler and it only ever indexes 2 pages?  (Read 9230 times)

wayne7

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Run crawler and it only ever indexes 2 pages?
« on: December 17, 2011, 09:49:56 PM »
Hello,

I've installed the stand alone generator and it seems to be configured correctly but I can't get it to index more that two page? I've been through the help and forum and can't locate the issue.

Please can you assist me.

Request date:
17 December 2011, 21:43
Processing time:
0:00:01s
Pages indexed:
2
Pages crawled:
2
Sitemap files:
1
Pages size:
0.00Mb

Thank you,
Wayne

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Run crawler and it only ever indexes 2 pages?
« Reply #1 on: December 18, 2011, 08:29:17 PM »
Hello,

what is your website URL?
You can try the SE bot simulator to check if your pages are visible to bots: http://www.xml-sitemaps.com/se-bot-simulator.html
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

wayne7

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Run crawler and it only ever indexes 2 pages?
« Reply #2 on: December 19, 2011, 04:57:48 AM »
Thank you for the feedback.  I tried that using the Google mode and the browser mode and both returned the content correctly showing the homepage and links that should be followed and those that should be blocked.

I've sent you a PM with the site details.

paul91

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Run crawler and it only ever indexes 2 pages?
« Reply #3 on: March 17, 2012, 12:49:23 PM »
I also have this exact same problem, what was the issue here?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Run crawler and it only ever indexes 2 pages?
« Reply #4 on: March 18, 2012, 01:19:00 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

paul91

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Run crawler and it only ever indexes 2 pages?
« Reply #5 on: March 19, 2012, 08:06:31 PM »
[external links are visible to admins only]
Hello,

please let me know your generator URL/login in private message to check this.


Pm sent as requested.

clive.walker

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Run crawler and it only ever indexes 2 pages?
« Reply #6 on: March 28, 2012, 06:36:28 PM »
Also getting a similar problem, any answer to this?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Run crawler and it only ever indexes 2 pages?
« Reply #7 on: March 29, 2012, 07:29:19 AM »
Hello,

try to disable "Canonical meta tags support" setting in generator configuration.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

clive.walker

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Run crawler and it only ever indexes 2 pages?
« Reply #8 on: March 29, 2012, 08:55:48 AM »
Thanks. I've updated to newer version of the script and it ran without problems. Old script may have been the issue

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2