how to exclude the parameter id_lang
« on: January 25, 2017, 04:47:55 PM »
hello,

how to exclude the parameter id_lang from crwaling ?
for example :

i have webpage with 2 langs :
https://www.cdsoft.co.il/index.php?id_product=305218&controller=product&id_lang=3
https://www.cdsoft.co.il/index.php?id_product=305218&controller=product&id_lang=1

i want to crawl and add to the sitemap, only the parameter with id_lang = 3

how to exclude it ?

and more :
if i want to exclude parameter from the middle of the url - example :
token
page

how to exclude it ?

thanks
Re: how to exclude the parameter id_lang
« Reply #1 on: January 25, 2017, 06:02:48 PM »
You can add "id_lang=1" in Exclude URls setting to avoid indexing any pages that include "id_lang=1" in URL.
The same for other parameters ("token=", "page="). That applies to parameter in any place in the URL.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: how to exclude the parameter id_lang
« Reply #2 on: January 26, 2017, 09:23:00 AM »
thanks,

but i still cant exclude it ... maybe im doing it wrong .

attached picture  - is this the right way ?
Re: how to exclude the parameter id_lang
« Reply #3 on: January 26, 2017, 11:21:15 AM »
Looks correct. What is an example URL that is still added in sitemap?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: how to exclude the parameter id_lang
« Reply #5 on: January 26, 2017, 11:47:16 AM »
Hello,

that URL doesn't contain "id_lang=1" or "token" hence not excluded by generator.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: how to exclude the parameter id_lang
« Reply #7 on: January 27, 2017, 06:22:48 AM »
Did you recreate sitemap after changing Exclude URLs setting?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: how to exclude the parameter id_lang
« Reply #8 on: January 27, 2017, 06:48:03 AM »
no - i didn't and from some reason - now the generator wont work

my cron job is :
curl "https://www.cdsoft.co.il/generator/index.php?op=crawlproc&resume=1" -k

why he wont work ?

all my cronjobs are working fine
Re: how to exclude the parameter id_lang
« Reply #9 on: January 27, 2017, 12:05:05 PM »
What is the error you get for this cron task?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.