Im using my generator for some time now and everything was working fine until may.
It has removed over 200 urls and dont want to crawl it back...
it looks like that
Pages scanned: 220 (5,181.4 Kb)
Pages left: 30 (+ 186 queued for the next depth level)
then it drops all the next level queued pages and finishes with 246 pages crawled for the sitemap!!
its not crawling new entries into the directory
it has removed the links to all the entries from the directory
it is still crawling all the other pages (categories, subcategories, search results)
[external links are visible to admins only]
Ive got few other pages on exactly the same script and generator is working fine there.
it is crawling all my links fine on [external links are visible to admins only]
Ive also tried other free generator from [external links are visible to admins only]
and it is working fine, crawling all the pages
ive updated the script to newest version
ive tried to reinstall the script
ive tried to use your free generator
still no joy