XML Sitemaps Discussions Category > Unlimited PHP Sitemap Generator

crawler wont scan SMF forum directory?



Our generator crawls the main website fine and produces XML and ROR sitemaps without problem, however I have noticed it only covers 48 links

I'm not sure why but it seems to miss out our forum installation in folder /smf

When I run a manual 'free' scan from the Xml-sitemaps.com website to mywebsite.com/smf it scans the folder fine and produces an output file too (albeit limited to 500 url's)

I've checked all permissions and everything seems fine (755), there is no exclusion of this folder in the config.

Please help


XML-Sitemaps Support:

please let me know your generator URL/login in private message to check this.


[0] Message Index

Go to full version