XML Sitemaps Generator

Author Topic: Decrease number of indexed pages and some new mistakes  (Read 14868 times)

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Decrease number of indexed pages and some new mistakes
« on: April 17, 2013, 06:10:47 AM »
We moved the site for the new hosting parameters (the same company but new virtual site with more capacity). But number of pages indexed in XML-file extremely decreased (from 67 thsn to 4 thsnd, DB is nearlly the same, pls see - [external links are visible to admins only], we use port 81 now instead ordinary address [external links are visible to admins only]). At the same time some new mistakes (in broken links) which is really opened. Could You pls, advise - what we should do to correct work?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Decrease number of indexed pages and some new mistakes
« Reply #1 on: April 17, 2013, 02:41:01 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #2 on: April 18, 2013, 05:35:15 AM »
Thanks for the answer. There are following:
1. Generator URL I used is [external links are visible to admins only]
2. Sample of the URL not included in XML-file - [external links are visible to admins only]
3. To reach this from homepage: [external links are visible to admins only] -> [external links are visible to admins only] (rus: "Все рубрики") -> list of headings.
4. Broken links like first "catalog/detail.php?ID=218221" looks strange (like some problems with Rus text coding - see [external links are visible to admins only]) and really work
5. Number of indexed pages is around 4 thsnd but was 67 thsnd
Hope your help, it's very important for us for indexing our Inet-directory!!!

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Decrease number of indexed pages and some new mistakes
« Reply #3 on: April 20, 2013, 03:52:35 PM »
This link is included in sitemap from what I can see:
  <url>
       <loc>http://www.abspb.ru/catalog/detail.php?ID=218121</loc>
       <lastmod>2013-04-16T13:49:14+00:00</lastmod>
       <changefreq>daily</changefreq>
       <priority>0.6400</priority>
  </url>
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #4 on: April 20, 2013, 06:22:44 PM »
I'm terribly sorry for this mistake.
Smth happend with search on my page.

Pls, check the following samples of the URL:
[external links are visible to admins only]
[external links are visible to admins only]

To reach this from homepage: [external links are visible to admins only] -> [external links are visible to admins only] (rus: "Все рубрики") -> list of headings and this heading which I send before: [external links are visible to admins only] (rus: ЛАБОРАТОРНОЕ ОБОРУДОВАНИЕ...)

After go to company by company from the listing for the minisite of each
ones

Another problems are:
- Broken links like first "catalog/detail.php?ID=218221" looks strange (like some problems with Rus text coding - see [external links are visible to admins only]) and really work
- Number of indexed pages is around 4 thsnd but was 67 thsnd

Sorry again, hope for your help...

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #5 on: April 23, 2013, 10:13:43 AM »
I'm sorry but need to bother for reminding about our problems.I can't make the new XML-file (we have every week mostly new DB) and it looks not o good for indexing by search sytem. Do You have smth to advise us?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Decrease number of indexed pages and some new mistakes
« Reply #6 on: April 25, 2013, 02:57:50 PM »
Looks like the issue is the same as described in older topic: http://www.xml-sitemaps.com/forum/index.php/topic,7436.html
i.e. some pages were not accessible when crawled opened them.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #7 on: April 26, 2013, 06:13:48 AM »
OK, I try to create again the XML-file this weekend. But before I did with the same result. The biggest problem for us - why number of pages decreased so many!!!

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #8 on: April 29, 2013, 12:10:11 PM »
I'm terribly sorry but I need to bother You again because no result of XML generator. We started the crawl yesterday and it finished with only 5'000 pages indexed. And I can't to continue - see the attachmented file!!! Before we restart it a few times and had around 60000. Pls, check what's happend?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Decrease number of indexed pages and some new mistakes
« Reply #9 on: April 30, 2013, 11:00:10 AM »
As mentioned above, the pages are not indexed since your server stops responding after a while when generator is crawling the site.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #10 on: April 30, 2013, 12:47:37 PM »
ОК, but why I can't continue the process? Before we had the same problems with the site. BUT I had possibility to continue... Now (see screen in previous post) I don't have it - only start new one, before was possibility to continue from the stopped place! That's my biggest question!

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Decrease number of indexed pages and some new mistakes
« Reply #11 on: May 06, 2013, 07:37:33 AM »
Possibly  crawl_dump.log file in generator/data/ folder is corrupted and generator  cannot read progress details.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #12 on: May 06, 2013, 08:13:36 AM »
Could You pls, advise what we can do in that way?

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #13 on: May 07, 2013, 12:35:46 PM »
And what can we do?

igors.kuvaga

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 47
Re: Decrease number of indexed pages and some new mistakes
« Reply #14 on: May 08, 2013, 12:29:16 PM »
I'm sorry but it's third time I ask the same question. What can we do in the situation You described? It's terrible for us - we need to update our XML-files, we bought your service specially fo it. May be we did smth wrong or no correct - pls, advise us!!!!

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2