Crawling Page broken

[support49]

After a week of sitemap generator's crawling the site I went to check on the progress today and the crawling page appears to be missing some parts. I've attached a screenshot.

Also, no sitemap file was created.

[XML-Sitemaps Support]

Hello,

Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

[support49]

PHP Fatal error:  Allowed memory size of 536870912 bytes exhausted (tried to allocate 116906983 bytes)
What do you suggest?


 How do I get the start button back?

[XML-Sitemaps Support]

"Run" button is not displayed because memory limit is exceeded when generator tries to read the log dump to show current progress, try to increase memoyr_limit even more.

[support49]

OK, but is there a way to force the creation of the sitemap files based on what's currently in the crawl_log rather than waiting for it to finish?

[XML-Sitemaps Support]

Hello,

yes, you should limit "maximum URLs" setting to tell generator not to crawl pages further, but you still need to increase memory_limit so that generator can read large dump that was already created.

[support49]

You can change the config while it's crawling?

[support49]

It finished crawling, but got errors about sitemap2.xml, sitemap3.xml, etc. not being writeable. Is it possible to recreate the sitemap files from the log file?

[support49]

sitemap1.xml works, but I get this message in Mozilla:

Parse error: syntax error, unexpected T_STRING in /home/xxxxxx/public_html/sitemap2.xml  on line 1

but the first line is exactly the same in both files. Any idea what would cause this?



######################\\

this seemed to fix the problem...

<Files ~ "sitemap2.*\.xml">
AddType application/xml xml
</Files>

[XML-Sitemaps Support]

Great, I'm glad it's working now.