XML Sitemaps Generator

Author Topic: Sitemap Not Crawling Through All The Pages  (Read 14228 times)

wolf22

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Sitemap Not Crawling Through All The Pages
« on: September 22, 2008, 11:14:14 AM »
Hello,

I have set up the configuration so many different ways, I have increased max_execution_time=500, memory_limit=256M. My website is a forum with about 70,000 pages, but it keeps coming up with about 2100 pages. Why does it not go through all the pages. I get no errors. It says on there that there are many more pages to add to the sitemap. It just doesn't add them, and then it says Congratulations, and returns back to the main menu.

Please help.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Sitemap Not Crawling Through All The Pages
« Reply #1 on: September 23, 2008, 10:32:29 AM »
Please PM me your generator URL/login to check this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

mirko.pianetti

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Re: Sitemap Not Crawling Through All The Pages
« Reply #2 on: April 29, 2009, 01:41:38 PM »
I have the same problem, but with a smaller site, crawler produces a sitemap, but this is mapping far less pages than we're expecting. help please!!!

[external links are visible to admins only]
Hello,

I have set up the configuration so many different ways, I have increased max_execution_time=500, memory_limit=256M. My website is a forum with about 70,000 pages, but it keeps coming up with about 2100 pages. Why does it not go through all the pages. I get no errors. It says on there that there are many more pages to add to the sitemap. It just doesn't add them, and then it says Congratulations, and returns back to the main menu.

Please help.


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Sitemap Not Crawling Through All The Pages
« Reply #3 on: April 29, 2009, 07:05:35 PM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting  from homepage?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2