Crawl is not moving past the 1000 pages
« on: July 30, 2008, 09:33:10 AM »
I have installed and configured the sitemap generator on my hosting account. My site is a dynamic site and has more than 2500 pages. When i do the crawl, everything goes fine until about 1000 pages, then it just stays where it is and does nothing. When i try to re-run from the previous spot it does a few more pages and stops. As i have a long way to go this is way too time consuming for me. I read various post on the forum suggesting that i increase the max_execution_time and memory_limit, but my host wont allow me to do this since my site is on a shared server.
The settings are as follows:
max_execution_time : 30
memory_limit: 16M

What can i do to get this to work? Any suggestions are welcome.

Site url: [ External links are visible to forum administrators only ]