XML Sitemaps Generator

Author Topic: stuck at 460 pages  (Read 16745 times)

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
stuck at 460 pages
« on: August 06, 2008, 12:31:57 PM »
I have downloaded the v2.9 and tried it with one of my domains and its stuck at this point.

Links depth: 1
Current page: 78_Tiruvallur/
Pages added to sitemap: 459
Pages scanned: 460 (28,156.9 KB)
Pages left: 44 (+ 50466 queued for the next depth level)
Time passed: 2:21
Time left: 0:13
Memory usage: 13,521.1 Kb

on the same server i have v2.7 installed for another domain which works smoothly. any help appreciated.

cheers
dave

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: stuck at 460 pages
« Reply #1 on: August 06, 2008, 04:41:40 PM »
Hello,

perhaps you have much more pages on this new domain compared to another one. Looks like you should increase max_execution_time and memory_limit settings significantly in PHP configuration on your server (php.ini) to avoid timeout issues.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #2 on: August 06, 2008, 09:08:19 PM »
this is what i see in when i check [external links are visible to admins only]

what do you think i m doing wrong here? the crawling now pauses after every 200-300 urls


max_execution_time 0
max_input_nesting_level 64
max_input_time -1
memory_limit 256M

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: stuck at 460 pages
« Reply #3 on: August 07, 2008, 04:03:15 PM »
Please PM me your generator URL.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #4 on: August 12, 2008, 09:32:58 PM »
i have sent u the PM. Still havent recd any response. help appreciated.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: stuck at 460 pages
« Reply #5 on: August 13, 2008, 02:33:54 PM »
Hello,

I've replied to you on:  August 10, 2008, 04:29:08 PM
Please double check that.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #6 on: August 13, 2008, 02:40:58 PM »
i apologies, didn't realise i had a PM from you.

sorry that did not work for me. I just tried running the generator again and it stopped at

Links depth: 2
Current page: 12/posts/2_Jobs/152_Sales_Jobs_/
Pages added to sitemap: 4681
Pages scanned: 4960 (190,494.3 Kb)
Pages left: 55170 (+ 18499 queued for the next depth level)
Time passed: 24:02
Time left: 267:22
Memory usage: 34,456.4 Kb
Resuming the last session (last updated: 2008-08-12 15:36:48)

thanks
dave

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #7 on: August 17, 2008, 10:01:17 PM »
hi,

I am still waiting for the reply.

cheers
nirav

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: stuck at 460 pages
« Reply #8 on: August 18, 2008, 08:51:19 PM »
Hello,

please try to install the latest version of sitemap generator (2.9) - you have v2.7 running now.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #9 on: October 13, 2008, 10:27:48 AM »
Hi,

I installed the latest version and things have not changed. The crawler now stops at every 480 pages

max_execution_time = 9000 ; Maximum execution time of each script, in seconds
max_input_time = 9000 ; Maximum amount of time each script may spend parsing request data
memory_limit = 32M ; Maximum amount of memory a script may consume (8MB)

I have sent you a PM with my details

Thanks
dave

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: stuck at 460 pages
« Reply #10 on: October 14, 2008, 10:06:07 AM »
Replied to your PM.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #11 on: October 14, 2008, 11:39:02 AM »
the problem is still the same.

i have increased the memory limit and max execution time, but it still freezes after crawling about 1000-1500 pages.

I have sent u a pm with details

my phpinfo is here
[external links are visible to admins only]

nirav

nirav.dave

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 14
Re: stuck at 460 pages
« Reply #12 on: October 15, 2008, 11:21:52 AM »
A faster response will definately help! :)

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: stuck at 460 pages
« Reply #13 on: October 15, 2008, 02:55:35 PM »
Replied to your PM yesterday, please double check your inbox.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2