new server
« on: October 25, 2008, 11:11:17 PM »
I've just moved to a new server and now I'm getting this message. I've made sure all of the files are 0666, but sitll get this error:

[25-Oct-2008 01:06:42] PHP Parse error:  syntax error, unexpected T_STRING in /home/ihsrea5/public_html/generator/data/sitemap15.xml on line 1
[25-Oct-2008 04:31:02] PHP Parse error:  syntax error, unexpected T_STRING in /home/ihsrea5/public_html/generator/data/sitemap13.xml on line 1
[25-Oct-2008 06:40:32] PHP Parse error:  syntax error, unexpected T_STRING in /home/ihsrea5/public_html/generator/data/sitemap12.xml on line 1
[25-Oct-2008 07:15:35] PHP Parse error:  syntax error, unexpected T_STRING in /home/ihsrea5/public_html/generator/data/sitemap14.xml on line 1

And this:

[25-Oct-2008 16:12:02] PHP Warning:  fopen(/home/ihsrea5/public_html/generator/data/crawl_state.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 32
[25-Oct-2008 16:12:02] PHP Warning:  fwrite(): supplied argument is not a valid stream resource in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 33
[25-Oct-2008 16:12:02] PHP Warning:  fclose(): supplied argument is not a valid stream resource in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 34
[25-Oct-2008 16:12:26] PHP Warning:  fopen(/home/ihsrea5/public_html/generator/data/crawl_state.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 32
[25-Oct-2008 16:12:26] PHP Warning:  fwrite(): supplied argument is not a valid stream resource in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 33
[25-Oct-2008 16:12:26] PHP Warning:  fclose(): supplied argument is not a valid stream resource in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 34
[25-Oct-2008 16:12:26] PHP Warning:  fopen(/home/ihsrea5/public_html/generator/data/crawl_dump.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 32
[25-Oct-2008 16:12:26] PHP Warning:  fwrite(): supplied argument is not a valid stream resource in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 33
[25-Oct-2008 16:12:26] PHP Warning:  fclose(): supplied argument is not a valid stream resource in /home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code on line 34

« Last Edit: October 25, 2008, 11:20:52 PM by support49 »
Re: new server
« Reply #1 on: October 26, 2008, 07:53:29 PM »
Hello,

1. Do you have sitemap12.xml..sitemap15.xml include in the main index sitemap (sitemap.xml)? It looks like those are just empty sitemap files and are not used in your sitemap.

2. Make sure that you have 0777 permissions for data/ folder and 0666 for all *files* inside data/ folder.
Re: new server
« Reply #2 on: October 27, 2008, 04:39:24 PM »
It's the same way it was on the old server and the permissions are set correctly as you suggest.

Sitemap in root: sitemap.xml

<?
header('Content-type: application/xml');
readfile('generator/data/sitemap1.xml');
?>

sitemap1.xml in /data/

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex
      xmlns="[ External links are visible to forum administrators only ]"
      xmlns:xsi="[ External links are visible to forum administrators only ]"
      xsi:schemaLocation="
            [ External links are visible to forum administrators only ]
            [ External links are visible to forum administrators only ]">

<sitemap>
   <loc>[ External links are visible to forum administrators only ]</loc>
   <lastmod>2008-10-10T17:19:38+00:00</lastmod>
</sitemap>
<sitemap>
   <loc>[ External links are visible to forum administrators only ]</loc>
   <lastmod>2008-10-10T17:19:38+00:00</lastmod>
</sitemap>
<sitemap>
   <loc>[ External links are visible to forum administrators only ]</loc>
   <lastmod>2008-10-10T17:19:38+00:00</lastmod>
</sitemap>
<sitemap>
   <loc>[ External links are visible to forum administrators only ]</loc>
   <lastmod>2008-10-10T17:19:38+00:00</lastmod>
</sitemap>
<sitemap>
   <loc>[ External links are visible to forum administrators only ]</loc>
   <lastmod>2008-10-10T17:19:38+00:00</lastmod>
</sitemap>
</sitemapindex>
Re: new server
« Reply #3 on: October 27, 2008, 07:49:38 PM »
Hello,

I get 404 file not found error for your sitemap links, you should manually create empty sitemap11.xml, sitemap12.xml etc files in domain root, set 0666 permissions and regenerate sitemap.
Re: new server
« Reply #4 on: October 29, 2008, 01:46:36 PM »
I see what you mean, but when I look at the file /generator/data/sitemap1.xml

I see links with the generator/data/ path in the file, but when I pull them up in a browser the generator/data path is missing. Why would that be?
Re: new server
« Reply #5 on: October 29, 2008, 01:59:54 PM »
the way i have it set up with google is

sitemapA.xml
sitemapB.xml
sitemapC.xml

etc

Re: new server
« Reply #6 on: October 29, 2008, 11:24:29 PM »
What is your "Save sitemap to" setting? It should be set to "/path/to/domainroot/sitemap.xml". In this case it will create main index sitemap as domain.com/sitemap.xml and other sitemap files as domain.com/sitemap1.xml domain.com/sitemap2.xml etc.
Re: new server
« Reply #7 on: October 31, 2008, 12:08:11 PM »
It's been a while, but I think the reason we did it this way is that our system uses

AddType application/x-httpd-php xml

so the sitemap files can't be read directly so the actual sitemap files are created in the domain.com/generator/data folder and I manually create files in the root folder like domain.com/sitemapA.xml which reads

<?
header('Content-type: application/xml');
readfile('generator/data/sitemap11.xml');
?>

for each of the sitemap files created.

The problem right now is that the generator script seems to keep halting (crashing the system at some points) even though I get emails like the one below which seem to indicate the script is completing, but no new sitemap files are created and the crawl page says 'Continue the interrupted session (2008-10-30 18:06:54, URLs added: 1217, estimated URLs left: 5059) '


X-Powered-By: PHP/5.2.6
Set-Cookie: PHPSESSID=34cdc2a6be530db4dbb73e878744c19a; path=/
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-type: text/html

<html>
<head>
<title>XML Sitemaps - Generation</title> <meta http-equiv="Content-type" content="text/html;charset=iso-8859-15" /> <link rel=stylesheet type="text/css" href="pages/style.css"> </head> <body> Resuming the last session (last updated: 1969-12-31 18:00:00)1 | 646 | 229.1 | 0:51 | 552:56 | 1 | 1,764.1 Kb | 1 | 0 | 1764 20 | 627 | 1,240.5 | 1:01 | 32:06 | 1 | 1,207.7 Kb | 20 | 686 | -557 40 | 607 | 1,573.4 | 1:10 | 17:54 | 1 | 939.9 Kb | 40 | 719 | -268 60 | 587 | 1,912.9 | 1:20 | 13:03 | 1 | 976.7 Kb | 60 | 766 | 37 80 | 567 | 2,245.0 | 1:29 | 10:35 | 1 | 999.4 Kb | 80 | 786 | 23 100 | 547 | 2,574.7 | 1:39 | 9:05 | 1 | 1,014.8 Kb | 100 | 800 | 15 120 | 527 | 2,902.4 | 1:49 | 7:59 | 1 | 1,031.5 Kb | 120 | 811 | 17 140 | 507 | 3,231.4 | 1:56 | 7:00 | 1 | 1,048.4 Kb | 140 | 824 | 17 160 | 487 | 3,573.9 | 2:03 | 6:15 | 1 | 1,076.0 Kb | 160 | 866 | 28 180 | 467 | 3,908.9 | 2:10 | 5:37 | 1 | 1,099.9 Kb | 180 | 889 | 23 200 | 447 | 4,240.5 | 2:17 | 5:06 | 1 | 1,116.2 Kb | 200 | 903 | 17 220 | 427 | 4,575.8 | 2:24 | 4:40 | 1 | 1,134.2 Kb | 220 | 921 | 18 240 | 407 | 4,911.3 | 2:31 | 4:17 | 1 | 1,153.2 Kb | 240 | 939 | 19 260 | 387 | 5,247.2 | 2:41 | 3:59 | 1 | 1,169.4 Kb | 260 | 949 | 16 280 | 367 | 5,582.0 | 2:50 | 3:43 | 1 | 1,186.8 Kb | 280 | 962 | 17 300 | 347 | 5,911.8 | 2:58 | 3:26 | 1 | 1,200.0 Kb | 300 | 966 | 14 320 | 327 | 6,243.9 | 3:07 | 3:11 | 1 | 1,214.5 Kb | 320 | 976 | 14 340 | 307 | 6,578.0 | 3:16 | 2:57 | 1 | 1,230.9 Kb | 340 | 984 | 16 360 | 287 | 6,910.6 | 3:25 | 2:43 | 1 | 1,245.4 Kb | 360 | 989 | 15 380 | 267 | 7,240.9 | 3:33 | 2:30 | 1 | 1,259.6 Kb | 380 | 994 | 14 400 | 247 | 7,570.9 | 3:42 | 2:17 | 1 | 1,274.7 Kb | 400 | 1006 | 15 420 | 227 | 7,901.8 | 3:51 | 2:05 | 1 | 1,290.5 Kb | 420 | 1016 | 16 440 | 207 | 8,232.5 | 3:58 | 1:52 | 1 | 1,305.4 Kb | 440 | 1019 | 15 460 | 187 | 8,565.3 | 4:05 | 1:39 | 1 | 1,329.7 Kb | 460 | 1026 | 24 480 | 167 | 8,902.1 | 4:13 | 1:28 | 1 | 1,341.5 Kb | 480 | 1030 | 12 500 | 147 | 9,229.5 | 4:20 | 1:16 | 1 | 1,352.1 Kb | 500 | 1030 | 11 520 | 127 | 9,572.0 | 4:28 | 1:05 | 1 | 1,381.0 Kb | 520 | 1037 | 29 540 | 107 | 9,901.1 | 4:35 | 0:54 | 1 | 1,383.3 Kb | 540 | 1038 | 2 560 | 87 | 10,230.9 | 4:42 | 0:43 | 1 | 1,398.6 Kb | 560 | 1039 | 15 580 | 67 | 10,560.0 | 4:49 | 0:33 | 1 | 1,411.9 Kb | 580 | 1040 | 13 600 | 47 | 10,835.0 | 4:56 | 0:23 | 1 | 1,409.5 Kb | 598 | 1045 | -2 620 | 27 | 11,193.7 | 5:07 | 0:13 | 1 | 1,474.9 Kb | 618 | 1159 | 65 640 | 7 | 11,598.1 | 5:16 | 0:03 | 1 | 1,555.8 Kb | 638 | 1590 | 81 660 | 950 | 12,912.8 | 5:28 | 7:52 | 2 | 2,707.5 Kb | 651 | 731 | 1152 680 | 930 | 14,215.7 | 5:40 | 7:45 | 2 | 2,820.4 Kb | 671 | 857 | 113 700 | 910 | 16,845.4 | 6:01 | 7:50 | 2 | 3,532.9 Kb | 691 | 1041 | 712 720 | 890 | 19,463.2 | 6:18 | 7:47 | 2 | 3,574.1 Kb | 711 | 1117 | 42 740 | 870 | 22,071.7 | 6:34 | 7:44 | 2 | 3,625.5 Kb | 731 | 1190 | 51 760 | 850 | 24,683.5 | 6:53 | 7:42 | 2 | 3,652.2 Kb | 751 | 1264 | 27 780 | 830 | 27,288.6 | 7:12 | 7:40 | 2 | 3,683.3 Kb | 771 | 1324 | 31 800 | 810 | 29,902.6 | 7:30 | 7:35 | 2 | 3,713.9 Kb | 791 | 1399 | 30 820 | 790 | 32,504.5 | 7:47 | 7:30 | 2 | 3,742.7 Kb | 811 | 1459 | 29 840 | 770 | 35,129.8 | 8:04 | 7:24 | 2 | 3,798.2 Kb | 831 | 1566 | 56 860 | 750 | 37,770.7 | 8:21 | 7:17 | 2 | 3,856.8 Kb | 851 | 1626 | 58 880 | 730 | 40,388.7 | 8:37 | 7:09 | 2 | 3,841.8 Kb | 871 | 1693 | -15 900 | 710 | 42,991.7 | 8:55 | 7:02 | 2 | 3,885.5 Kb | 891 | 1756 | 44 920 | 690 | 45,585.6 | 9:13 | 6:54 | 2 | 3,922.3 Kb | 911 | 1816 | 37 940 | 670 | 48,173.1 | 9:30 | 6:46 | 2 | 3,951.4 Kb | 931 | 1877 | 29 960 | 650 | 50,781.8 | 9:49 | 6:38 | 2 | 3,977.0 Kb | 951 | 1938 | 26 980 | 630 | 53,392.2 | 10:09 | 6:31 | 2 | 4,017.7 Kb | 971 | 1999 | 40 1000 | 610 | 55,997.4 | 10:26 | 6:21 | 2 | 4,045.8 Kb | 991 | 2059 | 28 1020 | 590 | 58,587.7 | 10:43 | 6:12 | 2 | 4,082.6 Kb | 1011 | 2119 | 37 1040 | 570 | 61,177.5 | 11:01 | 6:02 | 2 | 4,129.6 Kb | 1031 | 2210 | 47 1060 | 550 | 63,197.6 | 11:16 | 5:50 | 2 | 3,185.8 Kb | 1051 | 2264 | -944 1080 | 530 | 63,872.7 | 11:25 | 5:36 | 2 | 2,502.3 Kb | 1071 | 2273 | -683 1100 | 510 | 64,560.2 | 11:35 | 5:22 | 2 | 2,535.9 Kb | 1091 | 2290 | 33 1120 | 490 | 65,488.4 | 11:47 | 5:09 | 2 | 2,674.4 Kb | 1111 | 2311 | 139 1140 | 470 | 66,397.4 | 11:58 | 4:56 | 2 | 2,694.1 Kb | 1131 | 2332 | 20 1160 | 450 | 67,085.7 | 12:08 | 4:42 | 2 | 2,598.2 Kb | 1151 | 2345 | -96 1180 | 430 | 68,116.1 | 12:18 | 4:29 | 2 | 3,442.4 Kb | 1171 | 2383 | 844 1200 | 410 | 69,146.8 | 12:30 | 4:16 | 2 | 3,463.5 Kb | 1191 | 2409 | 21 1220 | 390 | 69,956.8 | 12:41 | 4:03 | 2 | 3,364.9 Kb | 1211 | 2447 | -99 1240 | 370 | 70,662.4 | 12:53 | 3:50 | 2 | 3,362.4 Kb | 1231 | 2498 | -2 1260 | 350 | 71,620.7 | 13:06 | 3:38 | 2 | 2,862.0 Kb | 1251 | 2528 | -500 1280 | 330 | 72,464.6 | 13:16 | 3:25 | 2 | 3,486.8 Kb | 1271 | 2550 | 624 1300 | 310 | 73,078.4 | 13:25 | 3:12 | 2 | 2,736.1 Kb | 1291 | 2573 | -750 1320 | 290 | 73,580.9 | 13:34 | 2:59 | 2 | 2,697.2 Kb | 1311 | 2586 | -39 1340 | 270 | 73,967.6 | 13:44 | 2:46 | 2 | 2,658.6 Kb | 1331 | 2588 | -39 1360 | 250 | 74,465.7 | 13:54 | 2:33 | 2 | 2,731.5 Kb | 1351 | 2602 | 73 1380 | 230 | 75,308.7 | 14:04 | 2:20 | 2 | 3,573.7 Kb | 1371 | 2622 | 842 1400 | 210 | 75,813.3 | 14:12 | 2:07 | 2 | 2,766.6 Kb | 1391 | 2639 | -807 1420 | 190 | 76,541.7 | 14:22 | 1:55 | 2 | 2,886.9 Kb | 1411 | 2650 | 120 1440 | 170 | 76,920.5 | 14:32 | 1:43 | 2 | 2,717.3 Kb | 1431 | 2653 | -169 1460 | 150 | 77,295.2 | 14:43 | 1:30 | 2 | 2,726.3 Kb | 1451 | 2654 | 9 1480 | 130 | 77,670.9 | 14:51 | 1:18 | 2 | 2,739.1 Kb | 1471 | 2655 | 13 1500 | 110 | 78,270.0 | 15:04 | 1:06 | 2 | 2,864.7 Kb | 1491 | 2664 | 125 1520 | 90 | 78,643.4 | 15:14 | 0:54 | 2 | 2,767.8 Kb | 1511 | 2665 | -97 1540 | 70 | 79,015.2 | 15:23 | 0:41 | 2 | 2,787.3 Kb | 1531 | 2665 | 20 1560 | 50 | 79,369.3 | 15:33 | 0:29 | 2 | 2,786.7 Kb | 1551 | 2665 | -1 1580 | 30 | 79,718.5 | 15:43 | 0:17 | 2 | 2,800.9 Kb | 1571 | 2666 | 14 1600 | 10 | 80,064.0 | 15:54 | 0:05 | 2 | 2,807.0 Kb | 1591 | 2667 | 7 1620 | 1069 | 81,548.7 | 16:05 | 10:37 | 3 | 2,307.4 Kb | 1607 | 70 | -500 1640 | 1049 | 81,566.1 | 16:11 | 10:21 | 3 | 2,324.3 Kb | 1616 | 81 | 17 1660 | 1029 | 81,585.5 | 16:19 | 10:07 | 3 | 2,343.9 Kb | 1626 | 91 | 19 1680 | 1009 | 81,605.0 | 16:25 | 9:52 | 3 | 2,364.2 Kb | 1636 | 101 | 21 1700 | 989 | 81,624.3 | 16:32 | 9:37 | 3 | 2,381.6 Kb | 1646 | 111 | 17 1720 | 969 | 81,643.8 | 16:40 | 9:23 | 3 | 2,401.3 Kb | 1656 | 121 | 20 1740 | 949 | 81,663.1 | 16:46 | 9:08 | 3 | 2,420.7 Kb | 1666 | 131 | 19 1760 | 929 | 81,682.5 | 16:51 | 8:54 | 3 | 2,438.3 Kb | 1676 | 141 | 18 1780 | 909 | 81,701.8 | 16:58 | 8:40 | 3 | 2,456.8 Kb | 1686 | 151 | 18 1800 | 889 | 81,721.2 | 17:04 | 8:25 | 3 | 2,474.1 Kb | 1696 | 161 | 18 1820 | 869 | 81,740.5 | 17:11 | 8:12 | 3 | 2,491.2 Kb | 1706 | 171 | 17 1840 | 849 | 81,759.8 | 17:19 | 7:59 | 3 | 2,508.5 Kb | 1716 | 181 | 17 1860 | 829 | 81,779.2 | 17:26 | 7:46 | 3 | 2,527.8 Kb | 1726 | 191 | 19 1880 | 809 | 81,798.6 | 17:34 | 7:33 | 3 | 2,546.3 Kb | 1736 | 201 | 19 1900 | 789 | 81,818.0 | 17:41 | 7:20 | 3 | 2,563.8 Kb | 1746 | 211 | 17 1920 | 769 | 81,837.4 | 17:49 | 7:08 | 3 | 2,581.8 Kb | 1756 | 221 | 18 1940 | 749 | 81,856.7 | 17:57 | 6:55 | 3 | 2,600.8 Kb | 1766 | 231 | 19 1960 | 729 | 81,876.2 | 18:04 | 6:43 | 3 | 2,621.4 Kb | 1776 | 241 | 21 1980 | 709 | 81,895.6 | 18:11 | 6:30 | 3 | 2,640.5 Kb | 1786 | 251 | 19 2000 | 689 | 81,915.1 | 18:18 | 6:18 | 3 | 2,660.9 Kb | 1796 | 261 | 20 2020 | 669 | 81,934.5 | 18:26 | 6:06 | 3 | 2,680.2 Kb | 1806 | 271 | 20 2040 | 649 | 81,952.0 | 18:34 | 5:54 | 3 | 2,698.4 Kb | 1815 | 280 | 18 2060 | 629 | 81,971.3 | 18:41 | 5:42 | 3 | 2,715.9 Kb | 1825 | 290 | 17 2080 | 609 | 81,988.8 | 18:48 | 5:30 | 3 | 2,735.0 Kb | 1835 | 298 | 20 2100 | 589 | 82,008.1 | 18:55 | 5:18 | 3 | 2,753.3 Kb | 1845 | 308 | 18 2120 | 569 | 82,027.4 | 19:03 | 5:06 | 3 | 2,772.2 Kb | 1855 | 318 | 19 2140 | 549 | 82,046.7 | 19:10 | 4:55 | 3 | 2,789.7 Kb | 1865 | 328 | 17 2160 | 529 | 82,064.1 | 19:17 | 4:43 | 3 | 2,804.6 Kb | 1874 | 338 | 15 2180 | 509 | 82,083.5 | 19:24 | 4:31 | 3 | 2,822.5 Kb | 1884 | 348 | 18 2200 | 489 | 82,102.8 | 19:30 | 4:20 | 3 | 2,843.0 Kb | 1894 | 358 | 21 2220 | 469 | 82,118.4 | 19:39 | 4:09 | 3 | 2,857.4 Kb | 1902 | 367 | 14 2240 | 449 | 82,137.7 | 19:45 | 3:57 | 3 | 2,878.1 Kb | 1912 | 376 | 21 2260 | 429 | 82,157.1 | 19:52 | 3:46 | 3 | 2,896.5 Kb | 1922 | 386 | 18 2280 | 409 | 82,176.4 | 19:59 | 3:35 | 3 | 2,914.8 Kb | 1932 | 396 | 18 2300 | 389 | 82,195.8 | 20:05 | 3:23 | 3 | 2,932.5 Kb | 1942 | 406 | 18 2320 | 369 | 82,215.1 | 20:12 | 3:12 | 3 | 2,950.5 Kb | 1952 | 416 | 18 2340 | 349 | 82,234.4 | 20:18 | 3:01 | 3 | 2,968.5 Kb | 1962 | 426 | 18 2360 | 329 | 82,253.8 | 20:23 | 2:50 | 3 | 2,986.2 Kb | 1972 | 436 | 18 2380 | 309 | 82,273.1 | 20:29 | 2:39 | 3 | 3,004.3 Kb | 1982 | 446 | 18 2400 | 289 | 82,292.6 | 20:35 | 2:28 | 3 | 3,024.4 Kb | 1992 | 456 | 20 2420 | 269 | 82,567.1 | 20:42 | 2:18 | 3 | 3,220.7 Kb | 2003 | 1054 | 196 2440 | 249 | 83,758.8 | 20:54 | 2:07 | 3 | 4,522.1 Kb | 2017 | 1117 | 1302 2460 | 229 | 85,066.8 | 21:08 | 1:58 | 3 | 4,608.4 Kb | 2032 | 1167 | 86 2480 | 209 | 86,519.4 | 21:20 | 1:47 | 3 | 3,995.5 Kb | 2048 | 1234 | -613 2500 | 189 | 87,579.2 | 21:31 | 1:37 | 3 | 3,809.4 Kb | 2062 | 1278 | -186 2520 | 169 | 88,765.0 | 21:41 | 1:27 | 3 | 3,900.1 Kb | 2076 | 1327 | 91 2540 | 149 | 90,088.3 | 21:53 | 1:17 | 3 | 4,738.6 Kb | 2091 | 1379 | 838 2560 | 129 | 91,154.5 | 22:03 | 1:06 | 3 | 4,664.3 Kb | 2105 | 1440 | -74 2580 | 109 | 93,539.0 | 22:19 | 0:56 | 3 | 4,619.3 Kb | 2124 | 1495 | -45 2600 | 89 | 94,872.1 | 22:31 | 0:46 | 3 | 4,894.1 Kb | 2139 | 1561 | 275 2620 | 69 | 97,243.3 | 22:48 | 0:36 | 3 | 5,430.7 Kb | 2158 | 1646 | 536 2640 | 49 | 99,616.2 | 23:04 | 0:25 | 3 | 5,488.5 Kb | 2177 | 1733 | 58 2660 | 29 | 100,952.0 | 23:17 | 0:15 | 3 | 4,996.9 Kb | 2192 | 1799 | -492 2680 | 9 | 102,658.1 | 23:32 | 0:04 | 3 | 4,460.0 Kb | 2209 | 1892 | -536 2700 | 765 | 105,961.0 | 23:50 | 6:45 | 4 | 5,148.6 Kb | 2227 | 647 | 688 2720 | 745 | 110,542.4 | 24:12 | 6:37 | 4 | 5,842.6 Kb | 2247 | 647 | 694 2740 | 725 | 115,123.8 | 24:35 | 6:30 | 4 | 5,859.8 Kb | 2267 | 647 | 17 2760 | 705 | 119,476.1 | 24:57 | 6:22 | 4 | 5,810.2 Kb | 2286 | 647 | -49 2780 | 685 | 124,057.5 | 25:22 | 6:15 | 4 | 5,888.9 Kb | 2306 | 647 | 78 2800 | 665 | 128,638.9 | 25:44 | 6:06 | 4 | 5,905.1 Kb | 2326 | 647 | 17 2820 | 645 | 133,220.3 | 26:07 | 5:58 | 4 | 5,920.1 Kb | 2346 | 647 | 15 2840 | 625 | 137,801.7 | 26:28 | 5:49 | 4 | 5,936.5 Kb | 2366 | 647 | 16 2860 | 605 | 142,383.1 | 26:50 | 5:40 | 4 | 5,952.9 Kb | 2386 | 647 | 16 2880 | 585 | 146,964.5 | 27:12 | 5:31 | 4 | 5,969.5 Kb | 2406 | 647 | 17 2900 | 565 | 151,545.8 | 27:34 | 5:22 | 4 | 5,987.3 Kb | 2426 | 647 | 18 2920 | 545 | 156,127.2 | 27:55 | 5:12 | 4 | 6,000.9 Kb | 2446 | 647 | 13 2940 | 525 | 160,708.6 | 28:16 | 5:02 | 4 | 6,015.4 Kb | 2466 | 647 | 15 2960 | 505 | 165,290.0 | 28:38 | 4:53 | 4 | 6,032.6 Kb | 2486 | 647 | 17 2980 | 485 | 169,871.4 | 29:00 | 4:43 | 4 | 6,048.2 Kb | 2506 | 647 | 16 3000 | 465 | 174,452.8 | 29:21 | 4:33 | 4 | 6,063.5 Kb | 2526 | 647 | 15 3020 | 445 | 179,034.2 | 29:42 | 4:22 | 4 | 6,079.2 Kb | 2546 | 647 | 16 3040 | 425 | 183,615.5 | 30:06 | 4:12 | 4 | 6,093.6 Kb | 2566 | 647 | 14 3060 | 405 | 188,196.9 | 30:28 | 4:01 | 4 | 6,108.4 Kb | 2586 | 647 | 15 3080 | 385 | 192,778.3 | 30:49 | 3:51 | 4 | 6,125.8 Kb | 2606 | 647 | 17 3100 | 365 | 194,849.7 | 31:03 | 3:39 | 4 | 4,222.9 Kb | 2620 | 654 | -1903 3120 | 345 | 196,010.6 | 31:16 | 3:27 | 4 | 3,968.4 Kb | 2633 | 661 | -254 3140 | 325 | 197,169.5 | 31:27 | 3:15 | 4 | 3,983.4 Kb | 2645 | 669 | 15 3160 | 305 | 197,874.3 | 31:35 | 3:02 | 4 | 3,876.6 Kb | 2657 | 677 | -107 3180 | 285 | 199,262.4 | 31:47 | 2:50 | 4 | 4,104.6 Kb | 2670 | 684 | 228 3200 | 265 | 200,650.4 | 31:58 | 2:38 | 4 | 4,123.1 Kb | 2683 | 691 | 19 3220 | 245 | 202,038.4 | 32:10 | 2:26 | 4 | 4,141.6 Kb | 2696 | 698 | 18 3240 | 225 | 202,285.0 | 32:19 | 2:14 | 4 | 4,999.3 Kb | 2706 | 708 | 858 3260 | 205 | 203,445.9 | 32:30 | 2:02 | 4 | 4,101.9 Kb | 2719 | 715 | -898 3280 | 185 | 203,465.3 | 32:37 | 1:50 | 4 | 3,784.2 Kb | 2729 | 725 | -317 3300 | 165 | 204,624.3 | 32:48 | 1:38 | 4 | 5,323.9 Kb | 2741 | 733 | 1539 3320 | 145 | 204,872.8 | 32:58 | 1:26 | 4 | 3,893.4 Kb | 2752 | 742 | -1430 3340 | 125 | 204,892.3 | 33:06 | 1:14 | 4 | 3,843.5 Kb | 2762 | 752 | -50 3360 | 105 | 205,138.8 | 33:14 | 1:02 | 4 | 3,928.8 Kb | 2772 | 762 | 85 3380 | 85 | 205,385.3 | 33:20 | 0:50 | 4 | 3,946.8 Kb | 2782 | 771 | 18 3400 | 65 | 205,404.8 | 33:27 | 0:38 | 4 | 3,898.5 Kb | 2792 | 781 | -48 3420 | 45 | 206,563.8 | 33:38 | 0:26 | 4 | 4,253.6 Kb | 2804 | 788 | 355 3440 | 25 | 207,039.5 | 33:48 | 0:14 | 4 | 5,259.5 Kb | 2815 | 797 | 1006 3460 | 5 | 207,744.1 | 33:57 | 0:02 | 4 | 4,163.4 Kb | 2827 | 805 | -1096 3480 | 145 | 211,184.0 | 34:15 | 1:25 | 5 | 5,936.4 Kb | 2844 | 647 | 1773 3500 | 125 | 215,536.3 | 34:43 | 1:14 | 5 | 6,275.8 Kb | 2863 | 647 | 339 3520 | 105 | 220,117.7 | 35:05 | 1:02 | 5 | 6,356.1 Kb | 2883 | 647 | 81 3540 | 85 | 224,699.1 | 35:27 | 0:51 | 5 | 6,369.9 Kb | 2903 | 647 | 13 3560 | 65 | 229,280.5 | 35:50 | 0:39 | 5 | 6,387.8 Kb | 2923 | 647 | 18 3580 | 45 | 233,861.9 | 36:13 | 0:27 | 5 | 6,403.4 Kb | 2943 | 647 | 16 3600 | 25 | 238,443.3 | 36:36 | 0:15 | 5 | 6,421.2 Kb | 2963 | 647 | 18 3620 | 5 | 243,024.6 | 36:58 | 0:03 | 5 | 6,436.9 Kb | 2983 | 647 | 15
3625 | 0 | 244,170.0 | 37:04 | 0:00 | 6 | 4,936.9 Kb | 2988 | 0 | -1500 <h4>Completed</h4>Total pages indexed: 2988<br>Calculating changelog...<br>Creating HTML sitemap...<script> top.location = 'index.php?op=view'
</script>
 
Re: new server
« Reply #8 on: November 02, 2008, 08:52:30 AM »
Hello,

instead of setting sitemap filename to data/ folder, try to create another folder (generator/data2/) and tell sitemap generator to store sitemaps in that folder:
Code: [Select]
/path/to/generator/data2/sitemap.xml
Re: new server
« Reply #9 on: November 03, 2008, 07:22:32 PM »
Now I get this:

X-Powered-By: PHP/5.2.5
Set-Cookie: PHPSESSID=b554ffd30d393bd91a6da0b91cd99c54; path=/
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-type: text/html

<html>
<head>
<title>XML Sitemaps - Generation</title>
<meta http-equiv="Content-type" content="text/html;charset=iso-8859-15" />
<link rel=stylesheet type="text/css" href="pages/style.css">
</head>
<body>
Resuming the last session (last updated: 2008-11-02 15:17:28)<br />
<b>Warning</b>:  fopen(/home/ihsrea5/public_html/generator/data/crawl_state.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>32</b><br />
<br />
<b>Warning</b>:  fwrite(): supplied argument is not a valid stream resource in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>33</b><br />
<br />
<b>Warning</b>:  fclose(): supplied argument is not a valid stream resource in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>34</b><br />
1140 | 925 | 60,509.7 | 44:55 | 36:27 | 2 | 3,410.6 Kb | 1013 | 2657 | 3410
<br />
<b>Warning</b>:  fopen(/home/ihsrea5/public_html/generator/data/crawl_state.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>32</b><br />
<br />
<b>Warning</b>:  fwrite(): supplied argument is not a valid stream resource in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>33</b><br />
<br />
<b>Warning</b>:  fclose(): supplied argument is not a valid stream resource in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>34</b><br />
1160 | 905 | 61,772.3 | 46:51 | 36:33 | 2 | 3,444.0 Kb | 1033 | 2703 | 34
<br />
<b>Warning</b>:  fopen(/home/ihsrea5/public_html/generator/data/crawl_dump.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>32</b><br />
<br />
<b>Warning</b>:  fwrite(): supplied argument is not a valid stream resource in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>33</b><br />
<br />
<b>Warning</b>:  fclose(): supplied argument is not a valid stream resource in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>34</b><br />
<br />
<b>Warning</b>:  fopen(/home/ihsrea5/public_html/generator/data/crawl_state.log) [<a href='function.fopen'>function.fopen</a>]: failed to open stream: Permission denied in <b>/home/ihsrea5/public_html/generator/pages/class.utils.inc.php(2) : eval()'d code</b> on line <b>32</b><br />
Re: new server
« Reply #10 on: November 04, 2008, 09:23:25 PM »
There is still permissions issue - either data/ folder permissions is not set to 0777 or files inside data/ folder are not set to 0666.
Re: new server
« Reply #11 on: November 05, 2008, 02:35:31 AM »
Not sure what else to do.   ??? The folder is 0777 and the files are 0666.
Re: new server
« Reply #12 on: November 05, 2008, 09:53:34 PM »
Try to remove files from data/ folder if you have them.
Can you provide ftp access in PM for troubleshooting?
Re: new server
« Reply #13 on: November 07, 2008, 02:23:28 PM »
I've sent you a message with FTP info.

I'm still getting emails from the server that indicate that the cron job ran and was successful,

X-Powered-By: PHP/5.2.6
Set-Cookie: PHPSESSID=beb677e064491006150195a4883b81f2; path=/
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
Content-type: text/html

<html>
<head>
<title>XML Sitemaps - Generation</title> <meta http-equiv="Content-type" content="text/html;charset=iso-8859-15" /> <link rel=stylesheet type="text/css" href="pages/style.css"> </head> <body> Resuming the last session (last updated: 1969-12-31 18:0... etc..
...<h4>Completed</h4>Total pages indexed: 2988<br>Calculating changelog...<br>Creating HTML sitemap...<script> top.location = 'index.php?op=view'
</script>

but no new xml files are created.

However, when I login online it says:

 Continue the interrupted session (2008-11-05 09:32:27, URLs added: 26584, estimated URLs left: 2358)


And no new sitemap pages are created.