Crawl process frozen

[services.clients]

Hi Oleg,

After installing the Unlimited PHP Sitemap Generator today I've run into problems with the crawling. I'm trying to create 6 site maps for 6 different language versions, each version of the site is about 150k pages.

After a very slow start, approx. 5000 pages indexed in 3 hours, I can now no longer access the xml-sitemaps control panel. The index.php?op=config page will no longer load. Initially I could at least follow the crawl progress and attempt to identify the reason why it was so slow.

The hosting service (shared server) control panel does not allow changes to the php.ini file but I have emailed them asking if they can change max_execution_time  and memory_limit settings in our php configuration.

Before it froze completely I tried using the ReloadEvery Firefox add-on to get around restrictions on php config modifications. It didn't seem to work, despite a few changes to the reload intervals.

During the crawl process the public pages of the website are often inaccessible. When pages are not displayed the server gives an error message [User mywebsitexyz already has more than 'max_user_connections' active connections].

Any help you can offer would be very gratefully received.

[XML-Sitemaps Support]

Hello,

try to open generator interface in other browser (or try to just close browser and reopen it).

[services.clients]

Hi -

Tx for your reply. Opened it with Chrome. After a few minutes the following error message displayed:

This webpage is not available.

The webpage at http://www.------------------------/index.php?op=crawlproc&bg=&resume=1 might be temporarily down or it may have moved permanently to a new web address.

  More information on this error
Below is the original error message

Error 324 (net::ERR_EMPTY_RESPONSE): Unknown error.

[XML-Sitemaps Support]

Hello,

please let me know your generator URL/login in private message to check this.

[services.clients]

Hi Oleg,

Sent you login details by PM early today. Looking forward to your illuminations.

David

[services.clients]

FYI Oleg - my hosting service provider replied: max_execution_time and memory_limit cannot be changed on shared hosting packages.

Regards,
David

[services.clients]

Hi Oleg - still hoping to get a response, do queries from paid-up customers not merit a response before handling posts from trial version users...

[services.clients]

Hi Oleg - just received the Standalone Sitemap Generator Report email, thanks.

I see that you changed the settings and ran the sitemap generator successfully.

You limited it to 25000 URLS and excluded contact and map pages.

To obtain a sitemap (in 3 files) of all 150k pages would you recommend I change the parameters and run it again?

[XML-Sitemaps Support]

Replied to your PM.