crawling problmes

[kajlan]

Hi

my sitemape only index the main page

why

everything is correct i double check it


i got no errors also

[ External links are visible to forum administrators only ]

[kajlan]

Solved


problem was from


No-follow

is there a way to leave no-follow and still be able to crawle the hole site


it,s a webdirectory 

[XML-Sitemaps Support]

Hello,

basically, the "nofollow" attribute is designed especially to exclude pages from indexing, so it's always taken into consideration by sitemap generator.

[kajlan]

the no-follow is tag in the header

<META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">

it,s saying index the page but don,t follow external links

follow internal page


but in the script it,s  indexing only the main page

is there an answer for this >>>?

[XML-Sitemaps Support]

Hello,

nofollow meta tag tells search engines not to follow ANY links on that page, not only external links: [ External links are visible to logged in users only ]