XML Sitemaps Generator

Author Topic: Not indexing all pages  (Read 19208 times)

simon2

  • Registered Customer
  • Approved member
  • *
  • Posts: 9
Not indexing all pages
« on: April 09, 2007, 10:55:00 AM »
Hi

I just installed the unlimted sitemap on my site which has almost 1000 pages on three levels. The problem is that the sitemap is only indexing 279 pages.

None of the pages have any robots meta tags and the links are not nofollowed. The robots.txt file doesn't restrict the spider from the pages that need indexing and permissions have been set as instructed in the documentation as follows:

Generator folder: 777
Data folder: 666
Sitemap.xml: 666
Ror.xml: 666
Config.inc.php: 666
Sitemap.html: 666
Urllist.txt: 666

I've also set up a cronjob which when completed displays a long list of warnings like this...

Warning:  fopen(/home/ukloans/public_html/generator/data/urllist.txt): failed to open stream:
Permission denied in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 93

Warning: fopen(/home/ukloans/public_html/generator/data/urllist.txt):
failed to open stream: Permission denied in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 93PHP Warning:  fwrite(): supplied argument is not a valid stream
resource in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 154

Warning: fwrite(): supplied argument is not a valid stream resource in
/home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2)
: eval()'d code on line 154 PHP Warning:  fwrite(): supplied argument is not a valid stream
resource in /home/ukloans/public_html/generator/pages/class.xml-creator.inc.php(2) : eval()'d code on line 154

Have I misssed something or is there a bug?

Thanks
Simon

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Not indexing all pages
« Reply #1 on: April 09, 2007, 10:10:13 PM »
Hello Simon,

generator/data/ folder permissions should be set to 0777 (not 0666).
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

simon2

  • Registered Customer
  • Approved member
  • *
  • Posts: 9
Re: Not indexing all pages
« Reply #2 on: April 10, 2007, 09:35:02 AM »
Sorry, the data folder is chmod 777

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Not indexing all pages
« Reply #3 on: April 10, 2007, 08:47:38 PM »
Hello,

replied to your private message.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2