XML Sitemaps Generator

Author Topic: Slow indexing problem  (Read 7891 times)

yol_yo_yo4

  • Registered Customer
  • Approved member
  • *
  • Posts: 9
Slow indexing problem
« on: July 25, 2011, 04:21:37 PM »
Hi there I run the sitemap and all goes well. However when it reaches around 35,000 the sitemap goes really, really slow. I was wondering how it could be sped up. I mean I think I will have over 200,000 pages to scan. How can I get it to scan quicker.

I also have foreign translated pages under directories of /de /es /it /pt /fr I thought of splitting them up so they would scan quicker. However when I set it as domain.com/de and only allow to inlude /de links it does not find them all. So back to scanning them all at once.
Any suggestions helpful.
regards.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Slow indexing problem
« Reply #1 on: July 25, 2011, 09:27:29 PM »
Hello,

you can add language pages in "Do not parse" setting to have them added directly in sitemap and speed up the process:
de/
es/
it/
etc..
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

yol_yo_yo4

  • Registered Customer
  • Approved member
  • *
  • Posts: 9
Re: Slow indexing problem
« Reply #2 on: July 27, 2011, 07:04:19 PM »
Hey I tried this it was a alot quicker thanks yet still does not crawl all foreign pages!

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2