1 page indexed :-(
« on: February 24, 2008, 04:42:44 AM »
Hi!
I'm trying to run crawler on my website and it indexes just one (main) page. I have tried to play as much as I could with settings according to documentation and this forum advices but nothing helped. Script is running for a while and for every each time it generates sitemaps with just one page.
I have tried yours free generator and it works fine but just up to 500 page.
But that how it looks XML generated sitemap like (by Unlimited):
<?xml version="1.0" encoding="UTF-8"?>
<urlset
      xmlns="[ External links are visible to forum administrators only ]"
      xmlns:xsi="[ External links are visible to forum administrators only ]"
      xsi:schemaLocation="
            [ External links are visible to forum administrators only ]
            [ External links are visible to forum administrators only ]">

  <url>
       <loc>[ External links are visible to forum administrators only ]</loc>
       <priority>0.50</priority>
       <changefreq>daily</changefreq>
       <lastmod>2007-03-17T03:50:05+00:00</lastmod> 
  </url>
</urlset>
I have been searching solution on this forum but without success

Link to generator:
[ External links are visible to forum administrators only ]
Link to main page:
[ External links are visible to forum administrators only ]

Thx for help
Re: 1 page indexed :-(
« Reply #2 on: April 29, 2008, 06:17:48 PM »
I am having the same problem. New at all this and just tried to crawl for the first time (several times in a row now) and only my main page indexes. The free online version successfully did 500 pages and quit. But his version I cannot get past the first page.

also, I have searched for an explanation of what a cron job is and can only get bits and pieces. Can someone tell me what a cron job actually means and how it's beneficial. Sounds like it automatically does this for you at a set time. If so, I won't EVER have to log in and make a sitemap again and Google will be notified automatically with each unsupervised generation???

..and, on that note, where the cron path is..... /usr/local/bin/php E:\Sites\BLAHBLAHBLAH\generator/runcrawl.php
does something go before that? Basically, how do I access it?

Thanks, again, sitemap newbie here so any VERY broken down explanations would be appreciated.
Re: 1 page indexed :-(
« Reply #3 on: April 29, 2008, 10:33:02 PM »
Hello,

make sure that you set Starting URL correctly (with www domain name in case if your other URLs reside on www domain).
Re: 1 page indexed :-(
« Reply #4 on: April 29, 2008, 11:27:14 PM »
Typed in I have:   [ External links are visible to forum administrators only ]
Isn't that correct?
Re: 1 page indexed :-(
« Reply #5 on: April 30, 2008, 11:56:42 AM »
Hi, make sure your starting domain does not have a "." after it.

Philip Nicosia
Re: 1 page indexed :-(
« Reply #6 on: April 30, 2008, 12:53:36 PM »
the first time it did
second and third times it did not
only indexed one page all three times
Re: 1 page indexed :-(
« Reply #7 on: April 30, 2008, 01:00:20 PM »
OK! It worked. I took the "." out but did not hit SAVE before going to Crawler tab so it must have defaulted back. Seems to be working as we speak.

Thanks for your assistance!