crawl start with url
« on: August 27, 2016, 05:22:17 AM »
if i just want to crawl start with following url, how to setup?

[ External links are visible to forum administrators only ]


e.g. it will crawl the following url
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
Re: crawl start with url
« Reply #1 on: August 27, 2016, 07:02:17 AM »
Hello,

You can add "product/product&product_id=" in "Include only" setting.
Re: crawl start with url
« Reply #2 on: August 27, 2016, 11:25:51 AM »
is it in "Include ONLY" URLs:?? i put there but i saw the debug log which also scan the url without thats string
Re: crawl start with url
« Reply #3 on: August 27, 2016, 11:33:58 AM »
what is the different of
1) Exclude URLs:
2) Add directly in sitemap (do not parse) URLs:
3) Crawl, but do not include URLs:
4) "Include ONLY" URLs:
5) "Parse ONLY" URLs:
??