Create Sitemap Page not openin
« on: March 09, 2019, 01:43:22 PM »
I had installed and configured XML Sitemap Generator, i started crawling, the status was like there are 66k pages and it will take 4-5 days, post completion when i am going to crawl page the page is not opening since 8 days.

Kindly help, i need to submit the sitemap to google for SEO and i have campaigns to run in near future.

Thanks
Re: Create Sitemap Page not openin
« Reply #1 on: March 09, 2019, 07:33:44 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Re: Create Sitemap Page not openin
« Reply #2 on: March 10, 2019, 07:07:50 AM »
I am getting 504 gateway timeout issue, the php configuration have 2gb memory limit and 3600 max_execution_timeout

Could you please help on the nginx conf changes?
Re: Create Sitemap Page not openin
« Reply #3 on: March 10, 2019, 07:38:45 AM »
Hello, 

in this case I would recommend to run generator in command line if you have ssh access to your server.
Re: Create Sitemap Page not openin
« Reply #4 on: March 10, 2019, 01:36:27 PM »
Note: The crawling was in progress and must have been completed, on running: /usr/bin/php /var/www/html/generator/runcrawl.php from CLI i dont want to crawl start from beginning. If you could help me in CLI commands i would be grateful.

FYI: I had run the crawler from CLI only, on interrupted session i used to use browser for resuming it.

The crawling was almost completed, but post that i was not able to view any status of it.

Re: Create Sitemap Page not openin
« Reply #5 on: March 10, 2019, 06:25:37 PM »
Hello,

the command line runcrawl.php script will resume the process automatically.
Re: Create Sitemap Page not openin
« Reply #6 on: March 10, 2019, 06:25:59 PM »
Also, you can try to increase memory_limit setting in generator configuration if you cannot open Crawling page.
Re: Create Sitemap Page not openin
« Reply #7 on: March 17, 2019, 09:53:18 AM »
I have kept 0 in the configuration for memory_limit
Re: Create Sitemap Page not openin
« Reply #8 on: March 17, 2019, 09:59:15 AM »
I have run the crawling via console, still no luck i cant see any output in console. Kindly help, its very urgent...
Re: Create Sitemap Page not openin
« Reply #9 on: March 17, 2019, 10:15:42 AM »
Its never ending process, please help me to reduce the time.
Re: Create Sitemap Page not openin
« Reply #10 on: March 17, 2019, 12:49:22 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: Create Sitemap Page not openin
« Reply #11 on: March 17, 2019, 03:42:44 PM »
I have shared the url in private message.
Re: Create Sitemap Page not openin
« Reply #12 on: March 18, 2019, 09:24:32 AM »
Any update here?
Re: Create Sitemap Page not openin
« Reply #13 on: March 18, 2019, 12:17:05 PM »
Replied to your PM yesterday.