• Welcome to Sitemap Generator Forum.
 

Problem with run crawling

Started by info2635, October 02, 2014, 11:26:40 AM

Previous topic - Next topic

info2635

Hi
Excuseme but i don't speak english
I have a web site from 950000 url
I have buy this software and installa folder generator with permession (view tutorial)

I went to create the page url (Crawling --> RUN) but after 20 it stops scanning

I contacted my hosting (aruba.it) and the php.ini file is configured in this way
memory_limit 128 MB
max_execution_time 120

Can i help me?  ::)


info2635

I reply your email
In this page there are url with:
Category --> Provincia --> City

for example: http://www.namesito/category/provincia/city.html

In italy there are 110 province and 8000 city and in the web site there are 70-80 category

In total there are 950000 url

XML-Sitemaps Support

Hello,

you need to separate that huge page on multiple pages, for instance one province listed per page.

info2635

Ok I'm editing the pages'll let you know

Thank you

info2635

I have this error
Links depth: 2
Current page: ...../......html
Pages added to sitemap: 2514
Pages scanned: 2515 (852,397.1 KB)
Pages left: 7941 (+ 176429 queued for the next depth level)
Time passed: 0:12:38
Time left: 0:39:53
Memory usage: 126,527.8 Kb
Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 26669050 bytes) in /web/htdocs/www.namesite.com/home/generator/pages/class.utils.inc.php on line 102

????

info2635

I don't have sa sitemap

from 6 days i don't a sitemap

This software are erro for create 960.000 url in my site

I don't understand.
Can i help me?

XML-Sitemaps Support

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 

info2635

I have to buy a hosting I want to know what should be the minimum value  memory_limit  and max_execution_time to be able to run your software

Thamk you