XML Sitemaps Generator

    Advanced search
Sitemap Generator Forum
July 05, 2008, 05:15:29 AM
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
   Home   Help Search Login Register  
Sitemap software 2.9 released - Email notifications, html sitemap customizing and more
6618 Posts in 1634 Topics by Members
Latest Member: mariebenz
Pages: [1]
  Print  
Author Topic: OK, I NEED HELP!  (Read 5042 times)
ONC Hosting
Registered Customer
Newbie
*
Posts: 9


View Profile
« on: March 12, 2007, 12:51:28 AM »

I have a large site.   Support ran the script for me once, from SSH and it was done in two days. 

Now, I have more pages, and I ran the crawler about 3 weeks ago, and it just runs and runs, but never seems to finish.   I look at my web stats and see that it is constantly looking at pages.   But it just does not seem to finish.

When I click on the Crawling Tab, it takes forever, and then just says it is crawling.   What should I do?

Should I stop the current crawl and restart it from SSH?   If so, I have two questions...

1.  How do I stop the current crwal, without it overwriting my last sitemaps?

2.   How (In detail please) do I run the script in SSH?

Thank you in advance for your help.
Logged
admin
Administrator
Hero Member
*****
Posts: 2755


View Profile
« Reply #1 on: March 12, 2007, 08:22:58 PM »

Hello,

1. you can upload the empty "interrupt.log" file in generator/data/ folder to stop the crawler.
2. running the script from SSH is as easy as:
- connect to your server via SSH as usually
- open sitemap generator in browser and select "Crawling" tab, there will be a command line under the "Cron job setup" heading
- enter that command line in SSH window
Logged

ONC Hosting
Registered Customer
Newbie
*
Posts: 9


View Profile
« Reply #2 on: March 12, 2007, 08:37:01 PM »

My site is up to 500,000 pages.   Is it usual for it to take this long?   Should I just wait it out?   Like I said, my site stats show it crawling...
Logged
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.5 | SMF © 2006, Simple Machines LLC Valid XHTML 1.0! Valid CSS!