• Welcome to Sitemap Generator Forum.
 

Crawling help.

Started by NOJ75, February 16, 2006, 04:58:27 PM

Previous topic - Next topic

NOJ75

Hi,

First time here.
I have set everything up correctly (I think) I ran the crawling section, it was running for over an hour and then nothing. Nothing at all has changed. I created sitemap.xml in public_html bit there is nothing in it. Any ideas.


Regards
Jon

XML-Sitemaps Support

#1
Hello Jon,

have you seen the progress indicated when you started the sitemap crawler?
Also, please check the "data/" folder in your sitemap generator directory - do you haev any files created there?

NOJ75

Hi admin,

Wow !! Fast reply, thankyou.

Nothing was placed into the /data/ location.

As the progress, I made sure that the option for not interupting it was on. On going back to check it all was working and it was crawling. Then when I checked for the last time I was taken back to the "start Crawling" page, nothing had chenged.  :-[

XML-Sitemaps Support

Hi,

could you please let me know your Generator instance URL in Provate Message so that I can take a look?

NOJ75


NOJ75

Hi Admin,

With reference to the PM you sent me. No, I dont have access, any other ideas?

Regards

XML-Sitemaps Support

Hello,

I suggest you to narrow the scope of pages included into sitemap using "Do not parse URLs" and "Exclude URLs" options.
For instance enter the following in both settings:
Quotenewreply.php
sendmessage.php
to skip all newreply.php?xxx pages on your site (that are realy not required in sitemap)
Similar for others non-important pages.

NOJ75

#7
Thanks,

I have excluded some of the links and it crawled nicely.

Any ideas what this is.?

When in the Analyze area I get this error:


Warning:  ksort() expects parameter 1 to be array, null given in /****/*****/*****/*****/pages/page-analyze.inc.php(2) : eval()'d code(1) : eval()'d code(1) : eval()'d code on line 60

Warning:  Invalid argument supplied for foreach() in /*****/*****/*****/*****/pages/page-analyze.inc.php(2) : eval()'d code(1) : eval()'d code(1) : eval()'d code on line 62

When trying to Download the xML file I get this:


System does not support the specified encoding. Error processing resource 'http://www.***********.com/sitemap.xml'. Line...

<?xml version="1.0" encoding="iso-8859-1"?>

Any ideas on these issues?
******* = replacing my data.


Kind regards

XML-Sitemaps Support

Great!

As for this issue, please make sure that you have set correct permissions for your data/ folder (the script should be able to write to it).

NOJ75

Hi,

Thanks again.

i already have the permissions set on the data file to CHMOD 777

Any other ideas?

Regards

maxiwebhost

Hi,
We just bought the script and i am also experience the same error by "Analyze":


Warning:  ksort() expects parameter 1 to be array, null given in /XXXX/XXXX/XXXX/XXXX/pages/page-analyze.inc.php(2) : eval()'d code(1) : eval()'d code(1) : eval()'d code on line 60

Warning:  Invalid argument supplied for foreach() in /XXXX/XXXX/XXXX/XXXX/pages/page-analyze.inc.php(2) : eval()'d code(1) : eval()'d code(1) : eval()'d code on line 62


Any ideas?


NOTE: Install path removed for security convenience.


XML-Sitemaps Support

NOJ75,  maxiwebhost,

please let me know the URL of your generator instance in Private Message so that I can check that.

Thank you!

XML-Sitemaps Support

Hello,

Update: the issue with analyze sitemap feature has been fixed in Sitemap Generator v2.1.
Please download the updated version to resolve the problem.

Thank you for reporting!

maxiwebhost

Thanks for your effort.
Installed the new version but still the same error in "Analyze".

The line are now 61 and 63.

maxiwebhost

Forget my previous post please.
I regenerated a map and now everythings are working well.
Thanks for the good work :D