not starting for certain urls

[mike33]

I have used sitemap generator successfully many times for different sites.  However for one site I cannot get it to continue.  The program starts but exits immediately, both from the web interface and from a command line prompt php ./runcrawl.php.

I am pm'ming the specifics.

You have been very helpful and it is a great product.

Thanks
Mike

[XML-Sitemaps Support]

Hello,

all URLs on that site are restricted with robots.txt, as reported by SE bot simulator:
https://www.xml-sitemaps.com/se-bot-simulator.html?op=se-bot-simulator&go=1&pageurl=http%3A%2F%2Fwww.drug-rehab-directory.info%2F&se=googlebot&submit=Start

[mike33]

Thank you

duh.....