Crawler crawls forever, but sitemap.xml is not written (not found)
« on: September 03, 2012, 06:06:12 PM »

I did everything described in the installation guide.

I am able to call the admin/configuration page and running the crawler script.

But the script is stucked or runs forever, do not know with the following message:

Already in progress. Current process state is displayed:
Links depth: 2
Current page: 55116-mainz-Apartment-mieten-rheinland-pfalz/eisgrub-appartement-1-2-personen/4449:-65375205:7:mr2.html?x=1&suchid=KUBZ6af78pwikTmcYCH&dsstart=1
Pages added to sitemap: 216
Pages scanned: 217 (22,716.5 KB)
Pages left: 266 (+ 205 queued for the next depth level)
Time passed: 0:01:40
Time left: 0:02:03
Memory usage: 22,354.9 Kb

Can anyone help me out?

The sitemap.xml has the proper permissions as well as the data folder.

Please help.

Thanx in advance

Regards Nick
« Last Edit: September 03, 2012, 06:16:47 PM by info2133 »
Re: Crawler crawls forever, but sitemap.xml is not written (not found)
« Reply #1 on: September 06, 2012, 06:05:52 AM »

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.