Can't get passed 63 entries
« on: April 17, 2013, 03:32:43 AM »
Links depth: 1
Current page: product.php?id=0486426939
Pages added to sitemap: 63
Pages scanned: 63 (1,951.8 KB)
Pages left: 169 (+ 2020 queued for the next depth level)
Time passed: 0:00:18
Time left: 0:00:50
Memory usage: 1,828.5 Kb

The page freezes around entry 63, like 15 seconds into it. The crawler seems especially sluggish.

I've experimented with tweaks to the settings and php.ini for a couple hours and I cant get this to work. It's strange, because this generator has worked fine for me on other websites. Can you help me out? Thanks.
Re: Can't get passed 63 entries
« Reply #1 on: April 17, 2013, 08:26:49 AM »
OK, i finally figured it out. I had to enter some substrings for the crawler not to parse. Works perfect now.