Crawl stopped, won't restart
« on: March 18, 2020, 03:55:13 AM »
Updated to the current version, started the crawl and ran for a while.  Timed-out.  I added more time and memory to the configuration and started it again.  It ran for a while and then stopped.  Now when I try to go to the "Create Sitemap" tab/page ([ External links are visible to forum administrators only ]) I get a 500 error.  But the error doesn't show up in the PHP log.

Could an .htaccess file be blocking the crawler and throwing it off?  If so, how can I find how where it's getting held up?
Re: Crawl stopped, won't restart
« Reply #1 on: March 18, 2020, 04:36:45 AM »
Hello,

I've increased memory limit setting, please try now.
Also, make sure to restrict access to sitemap generator using "Require authorization " setting in "Customize" tab.
Re: Crawl stopped, won't restart
« Reply #2 on: March 18, 2020, 04:03:27 PM »
Running again.  Thanks for your help and quick reply!