problem with crawling
« on: January 18, 2009, 06:19:43 PM »

can you say where is the problem?

crawling start normally. Then stop "crawling" and nothing happend.

Links depth: 4
Current page: lrsmlr _2409.jpg
Pages added to sitemap: 2221
Pages scanned: 3000 (129,685.5 KB)
Pages left: 871 (+ 382 queued for the next depth level)
Time passed: 4:59
Time left: 1:26
Memory usage: 3,372.8 Kb

the error is:
"Error in my_thread_global_end(): 1 threads didn't exit "

« Last Edit: January 18, 2009, 06:21:17 PM by damokles »
Re: problem with crawling
« Reply #1 on: January 18, 2009, 09:06:43 PM »

looks like images are crawled for some reason here, please make sure that you have "jpg" in "Exclude extensions" option.
Oleg Ignatiuk
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.