• Welcome to Sitemap Generator Forum.
 

Sitemap ignores the robot.txt

Started by coolbits, June 19, 2019, 07:39:13 PM

Previous topic - Next topic

coolbits

Sitemap ignores the robot.txt
In robots.txt prohibited:
Disallow: /*&v=list

Sitemap:
/catalog/teplye-kolgotki?page=2&v=list&s=hit&d=desc

Option "Use robots.txt" enabled, but do not work.

XML-Sitemaps Support

Hello,

please let me know your generator URL/login in private message to check this.

Also, you can add this in Exclude URLs setting:
v=list