I have 90,000 documents in my website.
And crawling documents take too long time, it seems not finish forever.
(Now I'm in depth 4 level it took 2 days)
Anyway what I want is that create sitemap.xml before finishing crawling.
Is there anyway that interrupt crawling in a while and create sitemap.xml?
I want to submit my sitemap to google even it has not full documents.