Firstly, I start the 'crawling' and after 1200 pages or so the entire process stops. IE showing page errors, "expected ']' , line: 1827, Character:31 URL: [external links are visible to admins only] .. whatever this means.
Also, the 'crawler is not picking up new pages. There's about another 11,000 added that are not being found or scanned.
Also, the CronJob code does not initiate any sitemap generation.
I've read many other forum issues but have not found any that are specific to the problems I'm having.