• Welcome to Sitemap Generator Forum.
 

The whole site is not getting crawled

Started by cds, January 30, 2006, 01:46:35 AM

Previous topic - Next topic

cds


Hi guys,

I've just bought the standalone site generator and I'm having trouble trying to gent completely crawled.

For example:

[ External links are visible to forum administrators only ]

Has about 21 links, and only these are in the urllist.txt file:

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

Also, there are some URL's that I need to know where are they coming from (referer). Is there a way to know it? I haven't been able to find it.

Best regards,

César Enrique


XML-Sitemaps Support

Hello,

please try to redownload the generator again (using the same link) and install it.
Let me know if that helps.

cds


Hello,

It  worked!. Thanks a lot.

I'll let you know how's everytghing going. So far it's ok.

Regards

César Enrique

cds

Hello Again,

I'm checking my the xml generated sitemap and I see some dates like this:

- <url>
  <loc>[ External links are visible to forum administrators only ]</loc>
  <priority>0.9</priority>
  <lastmod>2008-05-01T00:00:00+00:00</lastmod>
  <changefreq>weekly</changefreq>
  </url>
- <url>
- <url>
  <loc>[ External links are visible to forum administrators only ]</loc>
  <priority>0.9</priority>
  <lastmod>2008-05-01T00:00:00+00:00</lastmod>
  <changefreq>weekly</changefreq>
  </url>
+ <url>

My server date is ok, and actually, the file "listados" is the same for both url, so I think it should be a problem in the scripts.

Please give me a feedback. Best regards,

César Enrique


gillybrat

I am having the same problem. I've redownloaded the script, reinstalled it, run it, and getting the same results.

I've checked my root folder, no robot.txt in sight...

Any ideas?

Thanks ???

XML-Sitemaps Support

Hello,


please PM me the access details for your Sitemap Generator instance and let me know the examples of URLs that are not included in sitemap.

Thank you!

gillybrat

Actually, I figured it out on my own....  Nothing wrong with the script, it was the moron using it!  LOL :D

Thanks though,
Anne