Sitemap Generation interrupted.
« on: November 08, 2020, 10:15:38 AM »
From the other Messages here. I understood that Generation of Sitemaps with more pages need more max execution time and more memory too.

But can you please tell how much execution time & memory is enough for my case, so I can get a rough Idea.

I have 10,000 (10k) pages to crawl by generator.
Re: Sitemap Generation interrupted.
« Reply #1 on: November 08, 2020, 11:00:42 AM »
Some added questions :

I have increased the max execution time to : 3600s (1 hour). Still it gets interrupted and doesn't completed the process in one go. shows the error : Error 524

Note that I have Cloudflare installed on the top as proxy server. Can Cloudflare be the cause?

I wish to set a Cron job generator. But before that just want to make sure that everything gets right in manual Crawl.
Re: Sitemap Generation interrupted.
« Reply #2 on: November 09, 2020, 09:11:29 AM »
Hello, 

in this case I would recommend to run generator in command line if you have ssh access to your server.
Re: Sitemap Generation interrupted.
« Reply #3 on: November 10, 2020, 10:54:18 AM »
The command line approach get things done for me. Thank you for your help 😇