Strange crawling problem - Sitemap Generator Forum

Sitemap Generator Forum

July 04, 2008, 11:06:25 AM
Welcome, Guest. Please login or register.
Did you miss your activation email?

Home

Help

Sitemap software 2.9 released - Email notifications, html sitemap customizing and more

6612 Posts in 1632 Topics by Members
Latest Member: RKS

Sitemap Generator Forum > XML Sitemaps Discussions Category > Unlimited PHP Sitemap Generator > Strange crawling problem

Pages: [1]

« previous next »

Author

Topic: Strange crawling problem (Read 2586 times)

philmpo

Registered Customer
Newbie

Posts: 2

Strange crawling problem

« on: January 14, 2008, 09:03:53 PM »

Hello,

I recently purchased a Sitemap Generator copy. I first had some problems with the crawling but when i increased the max_execution_time setting it worked fine and crawled about 9000 pages everytime i started crawling.

Since I update my site every day, I just wanted to start crawling again and then all of a sudden it only crawled 84 pages. I've tried it about 20 times now but it always only crawls 84 pages. What is going on? There really seems to be something wrong, the crawl page also always shows me that the link depth value is 1, even though i set it to 2.

What should I do now? Re-install the script? I need some help here please.


	Logged

admin

Administrator
Hero Member

Posts: 2755

Re: Strange crawling problem

« Reply #1 on: January 15, 2008, 12:19:01 AM »

Hello,

please let me know your generator URL and an example URL that is not included in sitemap via private message.


	Logged

Oleg Ignatiuk
http://www.xml-sitemaps.com