Cannot Exclude a site URL from being crawled
« on: October 18, 2006, 10:01:29 PM »
Hello, i have put this URL "in the URLs not to be crawled, the excluded URLS list" but it still crawls the php file i put in the exclude options in the settings...

I am trying to get the generator to exclude

[ External links are visible to forum administrators only ]

Why isnt it excluding that URL, when i put it in the excluded URLs section??

Thank you for any help :)
Re: Cannot Exclude a site URL from being crawled
« Reply #1 on: October 18, 2006, 11:58:32 PM »
Hello,

you should not include domain URL in this field. Please try excluding "forums/calendar.php" or even "calendar.php" instead.
Re: Cannot Exclude a site URL from being crawled
« Reply #2 on: October 19, 2006, 01:05:01 AM »
will do, thanks :)