• Welcome to Sitemap Generator Forum.
 

URL's are crawled but not added in sitemap

Started by office83, May 02, 2015, 10:52:26 PM

Previous topic - Next topic

office83

Hi, can someone explain to me way is not adding to sitemap the urls?
Is there something wrong in my configuration?
Pages crawled: 9000 (482 added in sitemap), Queued: 7518, Depth level: 3
Thank you


office83

Hi,
you are right in the log file i get this;
[ External links are visible to forum administrators only ] - lu - [ External links are visible to forum administrators only ]

but i am crawling the https site not the http and all shop is redirected to https from http.

Can you let me know if i can do something.
Thank you

XML-Sitemaps Support

Hello,

make sure that "Allow subdomains" setting is disabled, otherwise generator will crawl both http and https links.

office83

I have try that, now seams to be ok, but still i have a 8000 page limit and i can generate that sitemap. Other limits are set to 0.
The Shop is in OC and there are a loot of url's to crawl but i can't even crawl this 8000 pages.
Can you please take a look it is possible that i have some bad settings :(.

Thank you