PROBLEM WHITH CRAWLING 5.0

[ventas11]

Hi,
we haven't got crawl more than about 20.000 links. We resume every time but it don't crawl more than 100 links each time and interrupt.

could you help me.

Thanks.

[ventas11]

allways finich whith something like that:

Thu Mar 15 17:17:30 UTC+0100 2012: resuming generator (120 seconds with no response)
Thu Mar 15 17:15:30 UTC+0100 2012: resuming generator (120 seconds with no response)
Thu Mar 15 17:13:30 UTC+0100 2012: resuming generator (121 seconds with no response)

and ..... finish. Resume and happens the same each time.

[XML-Sitemaps Support]

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

[ventas11]

no, it isn't the problem because i have set no time limit and no memory limit.

[XML-Sitemaps Support]

It's defined in php.ini on server side, not in generator configuration.

[ventas11]

yes, i know. But i'm trying to say you that in php.ini i set the time limit and the memory limit to infinite. And it continue failing.

Thanks

[ventas11]

hello,
well i think that the memory and time limit memory is solved, but the crawling is finished and only crawls 11.000 pags and i have got more than 330.000 products.

Please, i need help.

Thanks.

[XML-Sitemaps Support]

Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?