XML Sitemaps Generator

Author Topic: Install in one server crawl another  (Read 16790 times)

freesn

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Install in one server crawl another
« on: July 01, 2009, 10:34:09 AM »
Hello
Can I install script in one server (example domain1.com/script) and crawl another site? (example domain2.com/site)


Thanks

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Install in one server crawl another
« Reply #1 on: July 03, 2009, 05:51:41 AM »
Yes, this is possible.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

freesn

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Install in one server crawl another
« Reply #2 on: July 21, 2009, 04:45:22 AM »
I try to do this and the script  (crawl) wait about 2 minutes and give ERROR, NO RESPONSE.
If I crawl [external links are visible to admins only] - no response
if I change settings to crawl small page with 3,5 links [external links are visible to admins only] script succesfully crawl it.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Install in one server crawl another
« Reply #3 on: July 21, 2009, 10:10:29 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

freesn

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Install in one server crawl another
« Reply #4 on: July 23, 2009, 04:42:47 AM »
I understand, but it is no way to do this!
If I pay additional money, can I have access to your unlimited ONLINE (on your host) xml sitemap generator? Do you have online version?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Install in one server crawl another
« Reply #5 on: July 23, 2009, 11:55:51 PM »
Hello,

we do not have unlimited online version at this time, but we are planning this.
If you have ssh access to your server, you can run sitemap generator in command line though.
Also, if your hosting control panel supports scheduled tasks (cron jobs), you can setup one to run sitemap generator.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

freesn

  • Registered Customer
  • Approved member
  • *
  • Posts: 5
Re: Install in one server crawl another
« Reply #6 on: July 26, 2009, 08:24:02 AM »
I have ssh access and which file with which command I need to run?

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10622
Re: Install in one server crawl another
« Reply #7 on: July 26, 2009, 09:09:07 AM »
You can find the command line on Crawling page of sitemap generator, it looks similr to:
/usr/bin/php /path/to/generator/runcrawl.php
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2