Million plus pages
« on: September 18, 2014, 05:49:44 PM »
We have a social site with few millions pages and up to 100,000 newly added pages on a monthly basis.

Please advise how we can configure this sitemap generator to get the best results while all pages also being added to the site map.

Re: Million plus pages
« Reply #1 on: September 19, 2014, 04:02:37 PM »

with website of this size the best option is to create a limited sitemap - with "Maximum depth" or "Maximume URLs" option limited so that it would gather about 200-300,000 URLs, which would be main pages representing "roadmap" sitemap for search engines.