• Welcome to Sitemap Generator Forum.
 

Sitemap crawling never stops/ends

Started by staffan.bruzelius, July 15, 2006, 11:35:39 AM

Previous topic - Next topic

dp

I just installed the unlimited site map yesterday
Jommla is installed on site .I have installed generator in the root folder

I am on shared hosting

The script runs and [ External links are visible to forum administrators only ] the last 12 hrs has scanned 5000 pages.The site has about 24000 pages

What are the suggestions with regard to php.ini file and config

I can install it only in generator folder.Can u send me a php.ini file if needed to be installed.What else do i need to do as regards config

XML-Sitemaps Support

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

dp

It is a shared hosting and i dont think i will have much luck with installing php.ini in the server.Can it be installed somewhere in the root folder?I saw a post by you suggesting that.

If so can you provide me a sample of the php.ini file format


johny.shery

pmed you.same problem.plz resolve asap.


info1746

Hi, dont know if this is the right topic, but it looks like it.
I running a cron job and it seems to work fine, but when I go into the generator manualy.
It always shows an unfinished job at the crawling tab.

When I select it and click run it finishes the job in just a few seconds ( while for the complete job 1400 pages are indexed) So I guess its just at the end that something with the job goes wrong.
Please help me out here.

Kund regards
John


sam16

I'm having similar problem here, but with extreme case.
The log files for the generator reached the size of 680 GB, yes GB.
And my server CPU reached of 100%, and stopped working many times.

Its very confusing, I'm sure there is something wrong, my site have no more than 50,000 URLs, but that for sure will not need of this resources.

I will appreciate if you take a look at generator configuration.
I will send you the URL of my site in private message, hopefully you can fix it.
Thanks

XML-Sitemaps Support


perhaps it's a long list of historical files, there is a setting in generator config to automatically cleanup old log files to avoid this issue.
Can you check if you have a suspiciously large file in data/ folder (much larger than others) or what is an averag log file size in your case?

angela7

Looks like I have a similar issue.

Sitemap crawl just never completes.

I do NOT have a php.ini file to edit, but did add ini_set('memory_limit','192M'); to the index.php file to solve another plugin memory issue.

Not sure how to add the memory execute line of code within this file to see if that helps?

XML-Sitemaps Support

Hello,

you'd need to update it in php.ini file (PHP configuration) or contact your hosting support to do that.

angela7

As I said, I do not have that file.

I CAN make edits to another file to do pretty much the same thing, but what I need to know is WHAT to add regarding the memory execute code?