UNLTD Generator works strange - too slow and never finished
« on: August 01, 2018, 07:09:46 PM »
Hi there! I am the Sitemap Generator Customer since 2012 or so. So, till this time everything worked good (not perfect, but good). This time I can not finish the crowling operation.

Old version (updated in 2017) crowls around 2.5 hours for 100 000 links and consumes not more than 255 megs of RAM. This one consumes more and more, and after few hours of work drops with different exceptions.

Also, I have a warning instantly in the shell:

PHP Warning:  json_encode(): Invalid UTF-8 sequence in argument in /var/www/vhosts/motogonki.ru/cp.motogonki.ru/generator2018/pages/class.utils.inc.php on line 254

So, I could not generate а page of sitemap for the last 24 hours. Changes settings, sets to '0' (unlimited), no way.

"No sitemaps found
Sitemap was not generated yet, please go to Crawling page to start crawler manually or to setup a cron job."

P.S. Launched on the own server 64Gb RAM/4 CPU under CentOS. Powerfull enuf, for sure. Everything works well else the new Generator.

Old version works as usual. As a spare.

This is the existing Sitemap (0666), generated with old version Generator - [ External links are visible to forum administrators only ]

Also works.

What I do wrong for example? Thanx.
Re: UNLTD Generator works strange - too slow and never finished
« Reply #1 on: August 02, 2018, 06:34:56 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: UNLTD Generator works strange - too slow and never finished
« Reply #2 on: August 03, 2018, 10:41:01 AM »
Hello, Oleg!

I also learned that updated Standalone PHP Sitemap Generator (up to v8.0) did not finished its processes after July, 31 2018. It stops every time after 60-75 mins on a 3rd depth level or so, with only 1500-1600 found links, and then can not continue the interrupted session, it initiates a new crowling every time (by submitting "Start creating Sitemap" neither with or without "Continue" checkbox on/off or run crowling in the shell).

In the end, Google can not see most of new articles, so we loosing a lot of incoming trafic because of this issue.
Re: UNLTD Generator works strange - too slow and never finished
« Reply #3 on: August 03, 2018, 10:58:54 AM »
And one more learning:

I just found that The "Unlimited Site Generator" I purchased two days is the same (at the script level, file sizes etc) as the Standalone Site Generator, so I'd like to return the payment and return to using "old" Site Generator.

It's probably someone's mistake, but... for now both do not work for the same reason and in the same way. So why I should pay for the new one? Have no reason for sure.
Re: UNLTD Generator works strange - too slow and never finished
« Reply #4 on: August 03, 2018, 06:58:36 PM »
Hello, 

in this case I would recommend to run generator in command line if you have ssh access to your server.
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.
Re: UNLTD Generator works strange - too slow and never finished
« Reply #5 on: August 05, 2018, 04:32:38 PM »
One more thing: after two days of work one of the processes has been successfully finished! Hallelujah.

But - once again -

The XLS stylesheets have ceased to work. Earlier it was possible to change the header and footer manually, now it's forbidden, and for some reason by default it use the remote stylesheet, not the file that was copied to the folder with the Sitemap XLS. Each time after regeneration, references to styles are lost. How to fix it?
Re: UNLTD Generator works strange - too slow and never finished
« Reply #6 on: August 05, 2018, 04:33:03 PM »
[ External links are visible to forum administrators only ]
Re: UNLTD Generator works strange - too slow and never finished
« Reply #7 on: August 06, 2018, 02:44:02 PM »
Hello,

you can modified generator/pages/mods/sitemap_xml_tpl.xml file for that :
Code: [ External links are visible to forum administrators only ]
<?xml-stylesheet type="text/xsl" href="http:/yourlinkto/sitemap.xsl"?>and regenerate sitemap after that.
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.