"Exclude URLs:" via "Do not parse URLs:"
« on: August 24, 2011, 02:48:47 AM »
I can understand “include in sitemap.xml” and “exclude from sitemap.xml”. But what fetch or parse mean?

What is the format of values in "Exclude URLs:" "Do not parse URLs:" fields please? Examples ?

I need to exclude [ External links are visible to forum administrators only ]
It works when I put in Exclude URLs and Do not parse URLs::
/web_design/themes
But why there are Exclude URLs and Do not parse URLs ?

Documentation.html does not say clear. There is no explanation for serialize, canonical URL ether. I believe it is related to other problem of double indexing a directory / and index.html
« Last Edit: August 24, 2011, 03:13:46 AM by Dimitri »
Re: "Exclude URLs:" via "Do not parse URLs:"
« Reply #1 on: August 25, 2011, 05:09:46 PM »
Hello,

"Do not parse" setting means that matching URLs will be included in sitemap, but links *from* those pages will not be followed.
Normally you can leave all settings in default state.
Re: "Exclude URLs:" via "Do not parse URLs:"
« Reply #2 on: August 25, 2011, 11:12:42 PM »
What does it mean "links *from* those pages will not be followed"? Did you mean search engines will not follow those links? Why? I thought the only way to tell engines nofolow is via robots.txt. Sitemap does not change robots.txt , doesn’t it?
What is "default state" ?

The question actualy was about the diference betwin "Exclude URLs:" via "Do not parse URLs:".
So what is the difference? And what is the correct format of those values ?
Examples ?
Re: "Exclude URLs:" via "Do not parse URLs:"
« Reply #3 on: August 27, 2011, 09:31:07 PM »
No, only sitemap generator will not follow those links. Settings defined in generator configuration do not affect the way search engines crawl your site, only generator.

> What is "default state" ?

"Default state" meant no changes made to any settings in generator config - it should work fine.

> The question actualy was about the diference betwin "Exclude URLs:" via "Do not parse URLs:".

The first setting excludes specified URLs from sitemap, while second option doesn't exclude specified URLs from sitemap.
Example:
Code: [Select]
folder/will exclude all URLs like
http://www.domain.com/folder/anything_here
http://www.domain.com/folder/anything_here_2
Re: "Exclude URLs:" via "Do not parse URLs:"
« Reply #4 on: August 27, 2011, 11:34:42 PM »
I see. But let's make it clear for everyone.
Let’s say I need not to include all in [ External links are visible to forum administrators only ] in sitemap generated by XML-Sitemap generator. Then what do I put exactly in Exclude URLs and Do not parse URLs or other fields of XML-Sitemap generator settings to do that?
Re: "Exclude URLs:" via "Do not parse URLs:"
« Reply #5 on: August 28, 2011, 04:41:39 PM »
Just put this in "Exclude URLs" setting:
Code: [Select]
folder/No need to change other settings.