Ive also had an extremely slow crawl.
Links depth: 5
Current page: bestop-khaki-diamond-supertop-with-tinted-windows-wrangler-54709-36-p-1436.html
Pages added to sitemap: 3241
Pages scanned: 4680 (118,191.4 Kb)
Pages left: 168 (+ 403 queued for the next depth level)
Time passed: 281:02
Time left: 10:05
Memory usage: -
Over 4 1/2 hours to index 3241 and scan 4680?
I can scan it with an online scanner in 10 minutes. I only have about 5000 pages. The server isnt slow either because I can surf around the site, run other process and the CPU and memory usage is low.
Any ideas why this is so slow?