XML Sitemaps Generator

Author Topic: Generate is only crawling home page  (Read 16405 times)

jaishree.knauff

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Generate is only crawling home page
« on: February 02, 2009, 08:09:56 PM »
Hi:
when I say run to index my site, it seems that it is only crawling the home page. It indexes 41 URls. So in other words it does not follow those links on the home page.
How do I change this? My site has about 2000 pages that need to be indexed.

Thanks
Jaishree

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Generate is only crawling home page
« Reply #1 on: February 02, 2009, 10:00:18 PM »
Please check your site with search engine bot simulator to make sure that pages are crawlable: http://www.xml-sitemaps.com/se-bot-simulator.html
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

jaishree.knauff

  • Registered Customer
  • Approved member
  • *
  • Posts: 3
Re: Generate is only crawling home page
« Reply #2 on: February 03, 2009, 03:19:58 AM »
The site is definitely traversable. I checked. However Sitemap Generator only goes to depth of 1. i.e. it only indexes home page but doesn't follow the links on the home page.

How do I fix this?
Jaishree

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10624
Re: Generate is only crawling home page
« Reply #3 on: February 03, 2009, 11:26:14 PM »
Hello,

please PM me your generator URL/login.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2