Google have 11 000 URL restricted by robots

[pinkstarfruit]

I have 11 000 url restricted by robots is that normal?


Google webmaster is blocking this kind of threads


/tags.php?tag=investment+in+thailand URL restricted by robots.txt

/threads/2207-Obama-Visit-To-Indonesia?p=2389 URL restricted by robots.txt

[XML-Sitemaps Support]

Hello,

if you don't want those pages to be indexed by search engines, you can keep the exclusion in robots.txt.

[pinkstarfruit]

Yeah i know but should i?

[XML-Sitemaps Support]

Perhaps you would want to index tags.php pages, as for the second example it looks like a duplicate URL for the topic.