XML Sitemaps Generator

Author Topic: Only crawles 1 page  (Read 9777 times)

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Only crawles 1 page
« on: April 08, 2013, 01:48:39 PM »
Hello, I have XML-Sitemaps allready for a while and I am very happy with it. Recently I had some problems with my site and the folder disappeared without a reason. I put everything back but now it only crawles 1 page and then it stops.

Before there were issues with firewalls but just before this all happened I had no problems and it crawled the whole site. I have tried it with disconnected firewalls but it had no success. Can anyone please help?

If necessary I will give access to the admin site.

Thank you!

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #1 on: April 09, 2013, 02:48:18 PM »
Well problem solved. I deleted the whole folder with the old scripts and uploaded again a fresh one. Did a little adjustment and now the crawling goes perfect!

I hope this can help somebody!

PS. The only thing I am not completely sure of is if everything is crawled. If I can have a check on that then it would be nice.....
« Last Edit: April 09, 2013, 02:54:53 PM by ViVa Computers »

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #2 on: April 09, 2013, 03:04:10 PM »
I have installed the script for a other site which is much smaller and it indexed at least 353 pages and for my main site only 53. I have set everything on unlimited so I don't know what I am doing wrong here.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Only crawles 1 page
« Reply #3 on: April 10, 2013, 02:15:07 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #4 on: April 10, 2013, 02:21:46 PM »
Thank you for the help and I send you a PM.

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #5 on: May 03, 2013, 11:05:10 AM »
Hello, I am sorry but here I am again wit the same problem. The script doesn't go further then 52 pages. We concluded that at first the problem was a ending slash on the url and this worked fine at first. Now I have update my site (joomla) but now it doesn't work anymore. The login credentials in the PM are still effective.

Thank you!

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Only crawles 1 page
« Reply #6 on: May 06, 2013, 07:40:14 AM »
>  but now it doesn't work anymore

What exactly is the issue you get?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #7 on: May 06, 2013, 09:31:02 AM »
It stops again at 52 pages. There are a lot more pages to crawl. I am sorry maybe I say it wrongly....it works......but not good.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Only crawles 1 page
« Reply #8 on: May 08, 2013, 04:47:01 PM »
Looks like some links are redirected to non-www domain. You should make sure that they are not redirected:
{ http://www.vivacomputers.nl/component/jvse/116-automotive?Itemid=1179 }

[[[ 301 Moved Permanently ]]] - 0.01s (0.01 + 0.00) array ( 'date' => 'Wed, 08 May 2013 16:45:02 GMT', 'server' => 'Apache/2.2.24 (Unix) mod_ssl/2.2.24 OpenSSL/1.0.0-fips mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635', 'location' => 'http://vivacomputers.nl/component/jvse/116-automotive/?Itemid=1179', 'content-length' => '274', 'connection' => 'close', 'content-type' => 'text/html; charset=iso-8859-1', 'x_csize' => 274, )
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #9 on: May 08, 2013, 05:01:45 PM »
That is strange. I use Redj component for redirecting url's and before there was no problem. What do you mean with none www. domain? When I click the url that you put on example it works. What would be the best solution in this?

Edit: I turned of the redirecting software to see if that made a difference but it didn't.
« Last Edit: May 08, 2013, 05:12:47 PM by ViVa Computers »

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ViVa Computers

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 10
  • Allways look on the bright site of life!
Re: Only crawles 1 page
« Reply #11 on: May 14, 2013, 06:40:32 PM »
Can you help me with those redirects? I have checked but I can't find were the redirect is. Is this the reason why the crawling stops?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Only crawles 1 page
« Reply #12 on: May 16, 2013, 01:14:59 PM »
You need to contact your site developer for this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2