sitemap.xml is empty [URGENT]
« on: April 06, 2007, 12:25:39 PM »
Hello,

I have uploaded all the files and folders as documented and started the indexing.  It is working well, but when I stopped the script to check if there is something coming in sitemap.xml file, I found the sitemap.xml file empty.

Also I found there is not sitemap.html file in data folder.

Would you please let me know why it is doing so and how can I avoid this as soon as possible?

Thanks.
« Last Edit: April 06, 2007, 12:27:33 PM by steven1 »
Re: sitemap.xml is empty [URGENT]
« Reply #1 on: April 06, 2007, 10:15:05 PM »
Hello,

sitemap files are created only after the whole crawling process is finished.
Re: sitemap.xml is empty [URGENT]
« Reply #2 on: April 07, 2007, 02:05:40 PM »
Hello,

sitemap files are created only after the whole crawling process is finished.

I have a large number of files in my website to index, I therefore tried to index only 5 files to check if it works good or not.  Please click on the following link to see the snapshot of the error I am getting.

[ External links are visible to forum administrators only ]

Thanks.
Re: sitemap.xml is empty [URGENT]
« Reply #3 on: April 07, 2007, 09:56:26 PM »
Hello,

you have defined paths for the sitemaps incorrectly. Make sure that files you specified are existing on your server.
Re: sitemap.xml is empty [URGENT]
« Reply #4 on: April 09, 2007, 02:17:45 PM »
Hello,

you have defined paths for the sitemaps incorrectly. Make sure that files you specified are existing on your server.

Would you please check the path and let me know what is wrong with the paths?

[ External links are visible to forum administrators only ]

I have public_html folder on root and sitemap.xml file and generator folder in public_html folder.

Thanks.
Re: sitemap.xml is empty [URGENT]
« Reply #5 on: April 09, 2007, 11:18:52 PM »
Hello,

you should not change any path settings unless you are sure it is required. You should reupload fresh config file from Sitemap Generator package and open your config screen - the paths should be filled automatically.
Re: sitemap.xml is empty [URGENT]
« Reply #6 on: April 12, 2007, 10:31:39 AM »
After a fresh sitemap upload, I checked it for 6-7 pages and it worked and created the sitemap.  Then I started crawling the whole site.  Although the site is large, but should it take more than 48 hours to complete?  The crawling process is going on and on and is not completed.

Thanks.
Re: sitemap.xml is empty [URGENT]
« Reply #7 on: April 13, 2007, 12:21:55 AM »
Hello,

yes, the crawling process may take some time, depending on the number of pages.
Re: sitemap.xml is empty [URGENT]
« Reply #8 on: April 16, 2007, 04:19:32 PM »
Its been 4-5 days and crawling is still going on day and night.  Should it take that much time?  Still around 3000 pages are done and 4000 pages are left?  Moreover, when I checked the status today, its showing the resume date of 10th April, however I did resume it today after stopping it.

What should I do?

Thanks.
Re: sitemap.xml is empty [URGENT]
« Reply #9 on: April 16, 2007, 10:32:11 PM »
Hello,

if you have SSH access to your host, you should try to execute it via command line for better performance.
Re: sitemap.xml is empty [URGENT]
« Reply #10 on: April 17, 2007, 10:53:42 AM »
I am on windows 2003 server.  It is still going on today.  I stopped it and resumed it and it says "Resuming the last session (last updated: 2007-04-10 08:31:54)".  Why it is giving me the old date?

Thanks.
Re: sitemap.xml is empty [URGENT]
« Reply #11 on: April 17, 2007, 10:33:55 PM »
Hello,

possibly the script cannot save the sessions state, make sure that generator/data/crawl_dump.log file is writable (has corresponding file permissions).
Re: sitemap.xml is empty [URGENT]
« Reply #12 on: April 18, 2007, 12:09:47 PM »
I can see lots of data in generator/data/crawl_dump.log  file it means the file is writable.  Moreover, I have already told you that when I created the sitemap with 6 pages, it worked and created the sitemap successfully.  But now when I ran it for the whole site, its taking days and days to complete.

Please resolve this issue as soon as possible, its been many days and the work is on pending.

Thanks.
Re: sitemap.xml is empty [URGENT]
« Reply #14 on: April 23, 2007, 03:57:24 PM »
After setting the variables in php.ini file, I resumed the crawl.  Should it work now?

Thanks.