not all pages are in sitemap.xml

[support304]

Hello

we have tried to use sitemap generator but more than 100K pages are not indexed and i 'm not sure why.


i have a lot of error in debug.log

({skipped actor/actorsprofile.php?ad_id=44169 - 402 Payment Required})

but when i access the page is just fine.
Please advice.

[XML-Sitemaps Support]

Hello,

it's possible that the server couldn't handle the number of requests generator crawler is sending. You can try to use "Make delay" setting to slow down crawling and avoid overloading server.

[support304]

i had tried with a 2 seconds  delay between each requests  but still is failing.

[XML-Sitemaps Support]

Hello,

please contact your site developer to find out why "402 Payment Required" response is returned by the site, there might be other reasons (possibly site blocks generator crawler after a while).

[support304]

ok we resolve that 402 but now we get

*** *** [ External links are visible to forum administrators only ]
# RETRY - 400 Bad Request - 400 - #

all pages like
[ External links are visible to forum administrators only ] we get it .

[XML-Sitemaps Support]

Hello,

this error message is caused by the same reason (server overloaded).

[support304]

Error loading stylesheet: An unknown error has occurred (805303f4)[ External links are visible to forum administrators only ]

what does it means ? Where is problem ?

[XML-Sitemaps Support]

Make sure that you open sitemap as [ External links are visible to logged in users only ] and not as [ External links are visible to logged in users only ]