XML Sitemaps Generator

Author Topic: Problem with the crawler  (Read 15722 times)

DJDaSilva

  • Registered Customer
  • Approved member
  • *
  • Posts: 1
Problem with the crawler
« on: July 19, 2008, 08:13:52 PM »
hi... i got a problem with the sitemap generator.

when i click on "crwaling" to generate my sitemap the genrator tries to crawl the following url:
Links depth: 184
Current page: nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/nudeblog/category/galleries/artnudes.php
Pages added to sitemap: 710

So what´s wrong there?
this site: nudeblog/category/galleries/artnudes.php
does not excist in my urls.

Michael


XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Problem with the crawler
« Reply #1 on: July 21, 2008, 12:27:47 AM »
Looks like there is an endless links loop on the site, I'd recommend to add this into "Exclude URLs" options:
Code: [Select]
nudeblog/category/nudeblogso only the main URL will be indexed and all nested are excluded.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2