Generator only crawling homepage
« on: June 11, 2011, 11:37:47 AM »
   I've just installed your unlimited sitemap generator after using the free one and finding that one to work well.

I've installed and set it up following the instructions but when I crawl it only crawls the homepage.

I have no robots.txt I have an index, follow meta tag.  Your free sitemap generator can crawl the website and return urls from the homepage.
I'm using standard html a hrefs with no javascript and none of the links are nofollowed.
I've run out of things to check.  I've also used your spider test tool and that returns all of teh links from the hompage ok.

Any ideas?  Is there something I'm doing wrong?  I'd rather not post the url in public but will provide it by PM...
Re: Generator only crawling homepage
« Reply #1 on: June 11, 2011, 03:47:00 PM »

please let me know your generator URL/login in private message to check this.