Not crawling whole site

[helyn]

I have the stand alone which you just installed...it is not doing my whole site. THe settings look right but only does 3943 pages I have or urls...I have over 35,000 .....I need whole site indexed. When it crawled it looked like it was getting all but the at end same number as before.

[rajagopalan]

I have the same problem.

I have installed the standalone registered version.

I have giving the starting URL as [external links are visible to admins only]. It is doing all pages for this but it is not including my sub-domain at [external links are visible to admins only].

When I try to give the starting URL as [external links are visible to admins only] and click the button for crawling, it does not continue and comes back to the configuration page.

Please advice how to crawl the entire site including sub-domains.

Thanks
Regards
Raj

[helyn]

I would like to add to my post with it did do more of site but still not close....it does about 15,000 pages...I noticed it says link level 2....this needs to be increased as my site has many folders with many galleries...so I think this may be the problem. Where do I change settings for this?
Thank you

[admin]

Hello,

please let me know (in private message) an example URL that is not included in sitemap and how it can be reached from homepage.

Raj,

I have installed the standalone registered version.

I have giving the starting URL as  It is doing all pages for this but it is not including my sub-domain at

According to XML sitemap protocol, it is not allowed to include URLs from different domains or subdomains in the same sitemap, so you will have to create a separate sitemap for every domain.

[rajagopalan]

Hi Oleg,

If I cannot include my sub-domains as part of my main domain for site-mapping, does it mean that I have to install XML-Stiemap software again separately in the sub-domain folder?

Please advice.

Thanks
Regards
Raj

[admin]

Hello,

yes, you should install separate instances of Sitemap Generator per (sub)domain.