XML Sitemaps Generator

Author Topic: Auto crawling  (Read 14003 times)

stonda

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
Auto crawling
« on: May 12, 2009, 07:57:14 AM »
Hi
Probably a stupid question. I installed the soft on my site and I would like to know if it is possible to crawl the site automatically, for example every 2 days ? If yes how ?
Regards

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: Auto crawling
« Reply #1 on: May 12, 2009, 11:12:32 PM »
Hello,

yes, it is possible.
You should setup a scheduled task (cron job) in your hosting control panel for that, the command line for cron task is displayed on generator Crawling page.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

stonda

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
Re: Auto crawling
« Reply #2 on: May 13, 2009, 06:27:32 AM »
Hi
I've seen the runcrawl.php on the Crawling page, but I don't understand how I can fit this and where i must add this command line ?
Can you explain or send me a link where this is explained.
Thanks

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: Auto crawling
« Reply #3 on: May 13, 2009, 10:33:52 PM »
Hello,

it should be configured in your hosting control panel, exact steps would depend on your host. You should contact your hosting support for details on how it's configured on your server.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

stonda

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
Re: Auto crawling
« Reply #4 on: May 14, 2009, 04:35:24 PM »
Hi
No information from the hosting support : they told me that they cannot help me, I have to see with the software manufacturer.
So ???
Thanks

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: Auto crawling
« Reply #5 on: May 15, 2009, 12:40:00 AM »
Can't say for sure, may be your host doesn't provide scheduled tasks functionaility.
For instance, in cPanel after logging in you would select "Cron jobs" item, then just enter the command line to run and save the task.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

921399

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 13
Re: Auto crawling
« Reply #6 on: May 17, 2009, 05:12:49 PM »
[external links are visible to admins only]
Can't say for sure, may be your host doesn't provide scheduled tasks functionaility.
For instance, in cPanel after logging in you would select "Cron jobs" item, then just enter the command line to run and save the task.

I am also confused , i didn't find the "Cron jobs " item after accessing my hosting CP.  ???

Btw, i have my fully serve authority but don't know how to use it at my site hosting .  :-[

bleifus

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Auto crawling
« Reply #7 on: May 18, 2009, 09:49:39 AM »
Do you have root aka ssh access to you server ?

921399

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 13
Re: Auto crawling
« Reply #8 on: May 18, 2009, 02:46:27 PM »
[external links are visible to admins only]
Do you have root aka ssh access to you server ?

Yes, i have .

I finally work out it , searched with GooGle .  :P

stonda

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
Re: Auto crawling
« Reply #9 on: May 19, 2009, 07:49:48 AM »
Hi it finally works. As my server is in french it was a litlle bit more difficult to find the solution. I have a way to plan task on the server and need only to copy the code : www/generator/runcrawl.php, then indicates when I want this code to be run.
Just a question : it asks me if it is php4 or php 5 ?
Thanks a lot.
Didier

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10623
Re: Auto crawling
« Reply #10 on: May 19, 2009, 11:22:13 AM »
Hello,

sitemap generator supports both PHP4 and PHP5, so it should work in any case.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

stonda

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 12
Re: Auto crawling
« Reply #11 on: May 19, 2009, 03:58:04 PM »
Ok thank you for your answer

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2