Crawler running, sitemap.xml still 0kb
« on: February 20, 2007, 04:10:32 PM »
The crawler is running and says:

ages added to sitemap: 163
Pages scanned: 180 (10,260.9 Kb)
Pages left: 1962 (+ 883 queued for the next depth level)
Time passed: 4:26
Time left: 48:26
Memory usage: -

But the sitemap.xml file is still 0kb in size. The permissions are set to 0666, like the docs said.
Is this normal? Is the xml file generated at the end or how does it work?
Re: Crawler running, sitemap.xml still 0kb
« Reply #1 on: February 20, 2007, 05:59:20 PM »

That is normal. The sitemap.xml file is not created until the script has finished crawling the site.
Philip Nicosia