XML Sitemaps Generator

Author Topic: Cannot Exclude a site URL from being crawled  (Read 25525 times)

j.gronlund

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Cannot Exclude a site URL from being crawled
« on: October 18, 2006, 09:01:29 PM »
Hello, i have put this URL "in the URLs not to be crawled, the excluded URLS list" but it still crawls the php file i put in the exclude options in the settings...

I am trying to get the generator to exclude

[external links are visible to admins only]

Why isnt it excluding that URL, when i put it in the excluded URLs section??

Thank you for any help :)

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Cannot Exclude a site URL from being crawled
« Reply #1 on: October 18, 2006, 10:58:32 PM »
Hello,

you should not include domain URL in this field. Please try excluding "forums/calendar.php" or even "calendar.php" instead.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

j.gronlund

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Cannot Exclude a site URL from being crawled
« Reply #2 on: October 19, 2006, 12:05:01 AM »
will do, thanks :)

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2