"Exclude URLs:" via "Do not parse URLs:"

[Dimitri]

I can understand "include in sitemap.xml" and "exclude from sitemap.xml". But what fetch or parse mean?

What is the format of values in "Exclude URLs:" "Do not parse URLs:" fields please? Examples ?

I need to exclude [ External links are visible to forum administrators only ]
It works when I put in Exclude URLs and Do not parse URLs::
/web_design/themes
But why there are Exclude URLs and Do not parse URLs ?

Documentation.html does not say clear. There is no explanation for serialize, canonical URL ether. I believe it is related to other problem of double indexing a directory / and index.html

[XML-Sitemaps Support]

Hello,

"Do not parse" setting means that matching URLs will be included in sitemap, but links *from* those pages will not be followed.
Normally you can leave all settings in default state.

[Dimitri]

What does it mean "links *from* those pages will not be followed"? Did you mean search engines will not follow those links? Why? I thought the only way to tell engines nofolow is via robots.txt. Sitemap does not change robots.txt , doesn't it?
What is "default state" ?

The question actualy was about the diference betwin "Exclude URLs:" via "Do not parse URLs:".
So what is the difference? And what is the correct format of those values ?
Examples ?

[XML-Sitemaps Support]

No, only sitemap generator will not follow those links. Settings defined in generator configuration do not affect the way search engines crawl your site, only generator.

> What is "default state" ?

"Default state" meant no changes made to any settings in generator config - it should work fine.

> The question actualy was about the diference betwin "Exclude URLs:" via "Do not parse URLs:".

The first setting excludes specified URLs from sitemap, while second option doesn't exclude specified URLs from sitemap.
Example:

Code Select Expand

folder/
will exclude all URLs like
[ External links are visible to logged in users only ]
[ External links are visible to logged in users only ]

[Dimitri]

I see. But let's make it clear for everyone.
Let's say I need not to include all in [ External links are visible to forum administrators only ] in sitemap generated by XML-Sitemap generator. Then what do I put exactly in Exclude URLs and Do not parse URLs or other fields of XML-Sitemap generator settings to do that?

[XML-Sitemaps Support]

Just put this in "Exclude URLs" setting:

Code Select Expand

folder/
No need to change other settings.