I have a "font" website and a "client area". I'd like the Crawling to follow the client area link and store also that pages to the xml map. How can I do this?
Re: 2 areas site - Crawling does not iclude all pages in the map
« Reply #1 on: July 14, 2011, 04:34:47 PM »
Hello,

generator is able to crawl pages that are visible for not logged in visitors. It doesn't make sense to included protected pages anyway, since search engines will not be able to access them.
Re: 2 areas site - Crawling does not iclude all pages in the map
« Reply #2 on: July 14, 2011, 06:15:21 PM »
I'm talking about "open" pages. But this is OK now. Now I have the opposite problem. It reads all the "open" pages from my client area, but only the home page from the "front" site. It does not follow the menu links (my menu is normal not flash, robots can read it as links). So my front pages is invisible on the map.