Can anyone explain why it takes a lot of time for crawling?
I'm already on it for 3 hours and still lacking about 6 hours to complete.
And I have to do the manual crowling every 15 minutes!
Pages added to sitemap: 1637
Pages scanned: 4146 (303,328.7 KB)
Pages left: 7940 (+ 2686 queued for the next depth level)
Time passed: 3:07:20
Time left: 5:58:45
Memory usage: 14,559.8 Kb
Resuming the last session (last updated: 2013-08-31 10:59:15)