XML Sitemaps Generator

Author Topic: Sitemap not crawling all dynamic urls  (Read 22304 times)

niculie.botes

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Sitemap not crawling all dynamic urls
« on: June 11, 2007, 10:01:59 AM »
Hi

Our website is [external links are visible to admins only]
Only around 20000 urls are picked up and there should be more the 50 000.

The script is run on a different script than the live server.

some of the urls are dynamic with only parameter info changing (ex tab= in the below two examples.)

[external links are visible to admins only]

[external links are visible to admins only]


Can you help please
Thanks
Niculie

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10621
Re: Sitemap not crawling all dynamic urls
« Reply #1 on: June 12, 2007, 12:13:41 AM »
Hello,

how this URL can be reached from homepage?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

niculie.botes

  • Registered Customer
  • Approved member
  • *
  • Posts: 2
Re: Sitemap not crawling all dynamic urls
« Reply #2 on: June 12, 2007, 08:26:08 AM »
On the home page there is a sectoin Investment highlights and underneath there are funds listed this will bring you to the url mentioned. Then there is a sidebar navigation that gives you the different dynamic urls when you click on it.

xml-sitemaps

  • Administrator
  • Sr. Member
  • *****
  • Posts: 146
    • XML-Sitemaps.com
Re: Sitemap not crawling all dynamic urls
« Reply #3 on: June 12, 2007, 06:09:35 PM »
I just clicked on every link listed under investment highlights to get a message saying

'The page cannot be displayed.

Either the page does not exist or we have technical problems.

Please check the URL or try again in a short while.'
Philip Nicosia
www.xml-sitemaps.com

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2