Only indexing 200 files...
« on: October 08, 2008, 11:53:37 PM »
My sitemap generator is only indexing 200 pages, then it stops - even though there's over 250 or so, and it *says* queued for next level: 174, after it's done 191. I don't understand why...
Re: Only indexing 200 files...
« Reply #1 on: October 09, 2008, 12:10:25 AM »
Proof! -

While scanning: [ External links are visible to forum administrators only ]
Once it hits 200...: [ External links are visible to forum administrators only ]
Re: Only indexing 200 files...
« Reply #2 on: October 09, 2008, 12:13:16 AM »
Also - The generator works just fine on the same server on another domain which we used to use it on, but now it's not working on this domain - I know it's installed right and permissions are fine, it's a linux server.
Re: Only indexing 200 files...
« Reply #4 on: October 10, 2008, 02:43:05 PM »
What is there to check? You already know what it does. You know my configuration works.
Re: Only indexing 200 files...
« Reply #6 on: October 11, 2008, 10:30:30 PM »
Replied to yours as well... the fact that this has taken over three days already is not acceptable.
Re: Only indexing 200 files...
« Reply #7 on: October 13, 2008, 07:26:29 AM »
Update: changing Starting URL from www.domain.com to domain.com resolved the issue.
For reference: it is recommended to use our search engine robot simulator tool for possible crawling problems diagnostics: https://www.xml-sitemaps.com/se-bot-simulator.html