Not indexing all pages
« on: April 09, 2007, 11:55:00 AM »
Hi

I just installed the unlimted sitemap on my site which has almost 1000 pages on three levels. The problem is that the sitemap is only indexing 279 pages.

None of the pages have any robots meta tags and the links are not nofollowed. The robots.txt file doesn't restrict the spider from the pages that need indexing and permissions have been set as instructed in the documentation as follows:

Generator folder: 777
Data folder: 666
Sitemap.xml: 666
Ror.xml: 666
Config.inc.php: 666
Sitemap.html: 666
Urllist.txt: 666

I've also set up a cronjob which when completed displays a long list of warnings like this...

Warning:  fopen(/home/ukloans/public_html/generator/data/urllist.txt): failed to open stream:
Permission denied in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 93

Warning: fopen(/home/ukloans/public_html/generator/data/urllist.txt):
failed to open stream: Permission denied in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 93PHP Warning:  fwrite(): supplied argument is not a valid stream
resource in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 154

Warning: fwrite(): supplied argument is not a valid stream resource in
/home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2)
: eval()'d code on line 154 PHP Warning:  fwrite(): supplied argument is not a valid stream
resource in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 154

Have I misssed something or is there a bug?

Thanks
Simon
Re: Not indexing all pages
« Reply #1 on: April 09, 2007, 11:10:13 PM »
Hello Simon,

generator/data/ folder permissions should be set to 0777 (not 0666).
Re: Not indexing all pages
« Reply #2 on: April 10, 2007, 10:35:02 AM »
Sorry, the data folder is chmod 777