Have installed the generator to 2 of my domains. Everything is exactly the same. On the one domain it is crawling without any dificulties. On the other it starts crawling and immediately ends with an error mesage, which I cannot read because it is only shown with a galnce. Disappears immediately.
Cannot find any difference in the installation of both sites. Can my domain be the reason for it? Can there be something which does not allow to crawl.
With this domain I as well have problems to get it crawled by Google. It still is not indexed yet. Have included a robot.txt file and google accepts the text of robot.txt.
Anybody here, who has an idea what can be wrong?