Sitemap Generator Forum

I had installed and configured XML Sitemap Generator, i started crawling, the status was like there are 66k pages and it will take 4-5 days, post completion when i am going to crawl page the page is not opening since 8 days.

Kindly help, i need to submit the sitemap to google for SEO and i have campaigns to run in near future.

Thanks

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 

I am getting 504 gateway timeout issue, the php configuration have 2gb memory limit and 3600 max_execution_timeout

Could you please help on the nginx conf changes?

Hello, 

in this case I would recommend to run generator in command line if you have ssh access to your server.

Note: The crawling was in progress and must have been completed, on running: /usr/bin/php /var/www/html/generator/runcrawl.php from CLI i dont want to crawl start from beginning. If you could help me in CLI commands i would be grateful.

FYI: I had run the crawler from CLI only, on interrupted session i used to use browser for resuming it.

The crawling was almost completed, but post that i was not able to view any status of it.

Hello,

the command line runcrawl.php script will resume the process automatically.

Also, you can try to increase memory_limit setting in generator configuration if you cannot open Crawling page.

I have kept 0 in the configuration for memory_limit

I have run the crawling via console, still no luck i cant see any output in console. Kindly help, its very urgent...

Its never ending process, please help me to reduce the time.

Hello,

please let me know your generator URL/login in private message to check this.

I have shared the url in private message.

Any update here?

Replied to your PM yesterday.