Stuck Between 800 and 2000 on crawling

[payments69]

I am indexing my forum and I got stuck at between 800 2000. I have about 100,000 URLs to crawl and I am sorry but I can't keep on resuming the the crawl since I will be doing that almost all the time. BTW i tried using the solution for this one https://www.xml-sitemaps.com/forum/index.php/topic,1305.0.html


Godaddy Host:


Here is where it is stuck at

Current page: index.php?topic=10035.30
Pages added to sitemap: 1300
Pages scanned: 1300 (46,462.1 KB)
Pages left: 4438 (+ 4629 queued for the next depth level)
Time passed: 11:23
Time left: 38:54
Memory usage: -

[XML-Sitemaps Support]

Replied to your PM.

[azmortgages]

I just installed 2.9 yesterday in hopes of correcting this same issue. The new version doesn't work any differently. I never get an error msg. It just stops at random.
Links depth: 2
Current page: Art/59897/185/Wedding-Favor-Selection-Some-Considerations.html
Pages added to sitemap: 1463
Pages scanned: 1480 (44,802.2 KB)
Pages left: 36 (+ 7127 queued for the next depth level)
Time passed: 30:28
Time left: 0:44
Memory usage: -
It will stop between 500 and 1500 pages. Restarting means it will crawl another 1000pages +- before it gets stuck again.
I tried at at least 20 times with different settings and I put the IP address in the box at the bottom of the config screen.
Thanks.

[azmortgages]

All the file permissions are correct. sitemap.xml is empty. Here's where it stopped this time.

Links depth: 2
Current page: Art/60070/186/Visit-the-landmarks-of-Birmingham.html
Pages added to sitemap: 1422
Pages scanned: 1440 (43,630.4 KB)
Pages left: 69 (+ 6950 queued for the next depth level)
Time passed: 29:38
Time left: 1:25
Memory usage: -

[XML-Sitemaps Support]

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.