Sitemap generation hangs - shared hosting environment

[andrew17]

Hi

I'm also having the timeout problem but, because I'm in a shared hosting environment, I can't increase execution times in Apache and I don't have ssh access.

I run a number of sites that are updated often and really wanted to be able to run a cron script to generate the maps. Unless I can fix this problem, I can forget about the cron.

[andrew17]

Now the script will not go past a certain point, even if I interrupt and resume it:
Links depth: 2
Current page: napp/show/Brochure.htm?id=249
Pages added to sitemap: 279
Pages scanned: 280 (4,416.1 KB)
Pages left: 70 (+ 548 queued for the next depth level)
Time passed: 5:38
Time left: 1:24
Memory usage: -

[XML-Sitemaps Support]

Please PM me your generator URL/login.

[andrew17]

Oleg, I appreciate your assistance, but the number of posts that end "Send me your URL" is a concern. Why is no solution posted?

[XML-Sitemaps Support]

The solution in most cases is to setup properly "Exclude URLs" / "Do not parse" / "Memory usage" and other options in sitemap generator configuration, which are usually unique for every website.

[andrew17]

Thanks for that information, Oleg.

Are there any guidelines covering these issues that we can access?

[andrew17]

Oleg, did you get my PM with the URL?

[andrew17]

I have now installed the Generator on a third, smaller, site and it hangs after 40 pages, failing to create the sitemap.

[XML-Sitemaps Support]

Replied to your PM, looks like sitemap has been created successfully:
Request date:
27 December 2008, 14:11
Processing time:
1197.80s
Pages indexed:
610

[andrew17]

Hi Oleg

looks like sitemap has been created successfully:

Yes, but I had to restart it several times. It would not work with a cron job.

Also, I have two other sites running the Generator. One needs the same multiple intervention as the original and the other (a much smaller site) will not create a site map at all.

Cheers
Andrew

[XML-Sitemaps Support]

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

[andrew17]

Hi Oleg

Thanks for the reply.

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

I'll ask our host and see what happens. ITM, this doesn't explain why the smallest site map will not run past 40 pages.

[andrew17]

OK, I'll try this one again!

My generator hangs after crawling the same 40 pages. Hello!

[XML-Sitemaps Support]

Hello,

did you try the suggestion posted above?

[andrew17]

did you try the suggestion posted above?

Even though I don't understand why I need to increase the memory and time-outs for an error that's occurring after 40 pages, I actually did add a php.ini file to the generator directory on all three sites and increased both the memory allocation and timeout.

Unfortunately, however, this failed to fix the error, hence my reposting.