The whole site is not getting crawled

[cds]

Hi guys,

I've just bought the standalone site generator and I'm having trouble trying to gent completely crawled.

For example:

[external links are visible to admins only]

Has about 21 links, and only these are in the urllist.txt file:

[external links are visible to admins only]
[external links are visible to admins only]

Also, there are some URL's that I need to know where are they coming from (referer). Is there a way to know it? I haven't been able to find it.

Best regards,

César Enrique

[admin]

Hello,

please try to redownload the generator again (using the same link) and install it.
Let me know if that helps.

[cds]

Hello,

It  worked!. Thanks a lot.

I'll let you know how's everytghing going. So far it's ok.

Regards

César Enrique

[cds]

Hello Again,

I'm checking my the xml generated sitemap and I see some dates like this:

- <url>
  <loc>[external links are visible to admins only]</loc>
  <priority>0.9</priority>
  <lastmod>2008-05-01T00:00:00+00:00</lastmod>
  <changefreq>weekly</changefreq>
  </url>
- <url>
- <url>
  <loc>[external links are visible to admins only]</loc>
  <priority>0.9</priority>
  <lastmod>2008-05-01T00:00:00+00:00</lastmod>
  <changefreq>weekly</changefreq>
  </url>
+ <url>

My server date is ok, and actually, the file "listados" is the same for both url, so I think it should be a problem in the scripts.

Please give me a feedback. Best regards,

César Enrique

[admin]

Hi,

please PM me your Generator instance URL so that I can check it.

[gillybrat]

I am having the same problem. I've redownloaded the script, reinstalled it, run it, and getting the same results.

I've checked my root folder, no robot.txt in sight...

Any ideas?

Thanks

[admin]

Hello,


please PM me the access details for your Sitemap Generator instance and let me know the examples of URLs that are not included in sitemap.

Thank you!

[gillybrat]

Actually, I figured it out on my own....  Nothing wrong with the script, it was the moron using it!  LOL

Thanks though,
Anne

[admin]

Hi Anne,

Ah, I'm glad it works fine!