XML Sitemaps Generator

Author Topic: Sitemap Generator 1.02  (Read 41798 times)

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Sitemap Generator 1.02
« on: July 05, 2005, 11:17:38 PM »
Standalone XML Sitemap Generator v1.02 has been released!

2005, July 05

ChangeLog
  • robots.txt protocol is supported ('*' and 'googlebot' user-agents are checked)
  • view current process state when crawler is in background mode
  • interrupt the crawler in background mode
  • show real current path on the configuration page
  • show sitemap summary block at the main (configuration) page
  • check if sitemap exists on the analyze page to avoid warning messages
  • split sitemaps on part per 49,999 URLs for consistency (instead of 50,000)
  • redirections to external domains are not followed anymore
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

info

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
  • Hello World
Re: Sitemap Generator 1.02
« Reply #1 on: July 19, 2005, 08:19:50 AM »
I from legiraffe.it

Well good work for the upgrade 1.06. The problem with ' in the URLs a remember.... But

I've read that the Standalone PHP Sitemap Generator support the Robots protocol.

For example look at[external links are visible to admins only]. For my opinion it work good and Google, yahoo and msn spider respect it.

But the crawler of Standalone PHP Sitemap Generator in my case do not respect the robots.txt.

Why? Is it not well formatted for you.

Sorry for my bad english and best regards

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Sitemap Generator 1.02
« Reply #2 on: July 19, 2005, 08:19:37 PM »
Hi,

your robots.txt looks ok. :) Do you have some disallowed URLs crawled by generator script?
If so, please PM me your generator instance URL so I can check that.
Thanks!
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2