XML Sitemaps Generator

Author Topic: Full site not crawled - urgent help required!  (Read 35243 times)

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #15 on: June 06, 2008, 10:16:30 AM »
Sent you message with generator url for my site where I cannot save the config file - please help.

Regards.

Jack.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #16 on: June 07, 2008, 12:50:48 AM »
Hello,

try to create .htaccess file in generator folder with one line:
RewriteEngine off
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #17 on: June 07, 2008, 04:28:21 PM »
Yes, creating the .htaccess file helped as it is saving the config now - but there is a starnge problem - the script is creating the sitemap.xml.gz file and the ror.xml but not writing the main sitemap.xml file. I have kept new blank file with necessary write permissions but no use... i have the old file with 666 permission - but its not updaing - could not find the file in the data folder also!

Kindly advice.

Thanks,

Jack.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #18 on: June 08, 2008, 11:51:08 PM »
Hello,

try to disable gzip compression option.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #19 on: June 10, 2008, 10:31:51 AM »
Disabling GZ compression worked but its giving memory errors - allocated memory is 32 mb and i had about 19000 urls crawled last time.

Please advice.

Jack.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #20 on: June 10, 2008, 11:18:17 AM »
You can reenable gzip compressions then. o I understand correctly that you have sitemap.xml.gz created in this case?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #21 on: June 10, 2008, 03:04:42 PM »
Done that and even increased the memory size to 64 mb... again stopping due to memory limits !

The earlier version of this script I had never craeted any problem for two years and my cron was working perfectly. Dont know what went wrong - can i use the earlier config.inc.php with this version..or it will create conflict...

Also, let me know if you can setup this for me and generate an error free xml file... I had 20000 + pages indexed on Google and I am afraid I may loose my position built with so much efforts. I will pay the charges and fees.

Regards.

Jack.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #22 on: June 10, 2008, 05:49:07 PM »
I have redone all process - now its generating a sitemap - but which got errors ... still no gz file in data folder.
Please set this up for me and help me generate a proper sitemap. You already have the url in your message box - I am sending it again with login and pass.

Let me know the charge and I will pay also.

Thanks,

Jack.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #23 on: June 11, 2008, 09:17:33 PM »
I see that you have gzip compression disabled now. In this case sitemap.xml file is created, no sitemap.xml.gz.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #24 on: June 12, 2008, 08:24:28 AM »
The sitemap.xml is created but full of errors - the sitemap.xml.gz is disabled and there is no such file in the data folder also.

Please help me generate a clean error-free file.

Thanks.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #25 on: June 12, 2008, 10:33:27 PM »
What exactly are the error you got?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #26 on: June 13, 2008, 03:36:05 PM »
Hi,

Initially there were many errors due to some abnormal characters in the tag field - which I have removed from the database.

Now the sitemap should be clean but when I try to validate I get the error:

XML Parsing Error: no element found
Location: [external links are visible to admins only]
Line Number 4, Column 1:

When I check the first four/five lines of the sitemap the structure seems to be perfect as it same as in othere sitemaps...

Please help - i have already lost position and  indexed page count has come down substantially ...

Regards,

Jack.

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #27 on: June 13, 2008, 10:44:01 PM »
What is the sitemap URL you submit?
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

dd.mediaplus

  • Registered Customer
  • Jr. Member
  • *
  • Posts: 16
Re: Full site not crawled - urgent help required!
« Reply #28 on: June 14, 2008, 08:19:57 AM »
[external links are visible to admins only]

XML-Sitemaps Support

  • Administrator
  • Hero Member
  • *****
  • Posts: 10625
Re: Full site not crawled - urgent help required!
« Reply #29 on: June 14, 2008, 10:09:18 PM »
I've just submitted sitemap to Google here:
http://www.google.com/webmasters/sitemaps/siteoverview

and it has been parsed correctly:
Quote
   
sitemap.xml
   Sitemap    9 minutes ago    OK    15434    Details

The validator could not process your sitemap since there is a large file create.
Oleg Ignatiuk
www.xml-sitemaps.com
Send me a Private Message

For maximum exposure and traffic for your web site check out our additional SEO Services.

 

SMF 2.0.12 | SMF © 2014, Simple Machines
XHTML RSS WAP2