Full site not crawled - urgent help required!

[dd.mediaplus]

Hi,

I have a domain at [external links are visible to admins only] and a forum at [external links are visible to admins only] and a news section at [external links are visible to admins only]

The sitemap is at the root domain and crawling the root and the forum perfectly. But unable to crawl the news section.

The news (word-press) section actual url is [external links are visible to admins only] but is redirected to [external links are visible to admins only] - so all the posts appear as [external links are visible to admins only] usinf .htaccess

Please advice me how to include the news section in the sitemap.

Regards.

Jack

[XML-Sitemaps Support]

Hello,

please PM me your generator URL so that I can have a detailed look.

[dd.mediaplus]

Sent you pm with generator url and details.

Thanks,

Jack.

[XML-Sitemaps Support]

Hello,

your news pages return 404 http code instead of code 200 (although page content is displayed), you can check that with http headers viewer.

[dd.mediaplus]

I am using the permalink to change the news/index.php/topic.html  -> news/topic.html

Any help how this can be resolved...

Thnaks.

[XML-Sitemaps Support]

You should correct your news script to resolve the issue - currently it returns 404 http code. Even if those pages will be manually included in sitemap, search engines won't index them until you address the http code problem.

[dd.mediaplus]

Solved the http header issue which was coming from a mix of wordpress and .htaccess. Now the sitemap is crawling the pages.

Cheers.

[XML-Sitemaps Support]

Excellent!

[dd.mediaplus]

I believe I can use this script for my other sites also in the same server ... but when I uploaded it in another site in the same server - could not save the config details or even the login pass - if I do a direct edit of the config file it saves but when I try to start crawling from the sitemap page button - it redirects me back to the index page of config - permissions are all OK.

Please help.

Cheers.

[XML-Sitemaps Support]

Hello,

make sure that you have 0666 permissions set for config.inc.php file.

[dd.mediaplus]

Thats done - but some hoe for some reason its not writing the config file and also not crawling .

Regards.

[XML-Sitemaps Support]

Please try to reinstall sitemap generator on your another site (remove generator folder and reupload files)

[dd.mediaplus]

Do I need to remove the sitemap html/xml/txt/gz files generated earlier with your earlier version ? They are all writeable - if the new sitemaps are not generated then I will be left with nothing...

Regards.

[XML-Sitemaps Support]

You can rename them (or move to subfolder) and create empty sitemap files and set 0666 permissions for them.

[dd.mediaplus]

Done that no use - maybe ownership problem or something else... Sending you the genrator url by pm please check - the earlier sitemaps were 78 in number !

PHP execution time is also increased at 100 from 30 earlier.

Thanks.