XML Sitemaps Generator

Author Topic: Generator doesn't crawl all the urls  (Read 9374 times)

ballinmj

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Generator doesn't crawl all the urls
« on: May 18, 2014, 12:43:29 AM »
The generator isn't crawling my entire site. My site has around 150k-200k pages, but it creates a sitemap after only 15k urls. What is the problem? It ran for around 19 hours.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Generator doesn't crawl all the urls
« Reply #1 on: May 20, 2014, 04:34:30 AM »
Hello,

replied to your email.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

ballinmj

  • Registered Customer
  • Approved member
  • *
  • Posts: 4
Re: Generator doesn't crawl all the urls
« Reply #2 on: May 22, 2014, 08:06:18 PM »
[external links are visible to admins only]
Hello,

replied to your email.
Hi. The unlimited depth levels did not solve the issue. It stopped again. I sent you another email.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Generator doesn't crawl all the urls
« Reply #3 on: May 24, 2014, 05:24:24 AM »
Replied.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2