excluding urls
« on: June 15, 2009, 11:15:22 PM »
Hi

I want to only keep these type of short titles urls in the sitemap

[ External links are visible to forum administrators only ]

and not these

[ External links are visible to forum administrators only ]

not sure what to put in the exclude urls

also found a load of these urls being uploaded which were not needed

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

I have added the following in exclude URLS

customer.php
callback.php
pricematch.php

is this correct

Thanks

Re: excluding urls
« Reply #1 on: June 16, 2009, 06:11:04 PM »
Hello,

you can add this in "Exclude URLs" setting:
Code: [Select]
xProd=
customer.php
callback.php
pricematch.php
and recreate sitemap.
Re: excluding urls
« Reply #2 on: June 17, 2009, 12:38:19 PM »
ok great thanks

getting this error in google webmaster

We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit

[ External links are visible to forum administrators only ] seems to load fine - any ideas whats causing the problem

TIA
Re: excluding urls
« Reply #3 on: June 17, 2009, 10:09:22 PM »
Please try to save it with different filename (like sitemapnew.xml) and resubmit.
Re: excluding urls
« Reply #4 on: June 19, 2009, 01:42:58 PM »
Hi Tried that the same problem persists

We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.    
Problem detected on:
Jun 19, 2009


[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

not sure why this is

Thanks
Re: excluding urls
« Reply #5 on: June 19, 2009, 01:49:59 PM »
just to update also get

for Robots Txt 404 (Not found)

[ External links are visible to forum administrators only ]

I have now put this in - not sure if it will fix the prob
Re: excluding urls
« Reply #6 on: June 22, 2009, 01:28:31 PM »
the problem still persists

TIA
Re: excluding urls
« Reply #7 on: June 22, 2009, 01:47:39 PM »
Another thing to try is to save it as sitemap.xml.gz and then enable gzip compression in generator configuration and recreate sitemap.
Re: excluding urls
« Reply #8 on: June 23, 2009, 11:15:50 PM »
[ External links are visible to forum administrators only ]

same problem - not sure what is happening ???
Re: excluding urls
« Reply #9 on: June 25, 2009, 01:32:37 PM »
any update

TIA
Re: excluding urls
« Reply #10 on: June 26, 2009, 01:04:51 AM »
I've tried to submit your sitemap to Yahoo and it has been processed correctly. If you can PM me your google webmaster login I'll check this further.
Re: excluding urls
« Reply #11 on: June 30, 2009, 02:19:49 PM »
Hi

I have PM'ed you details - havent received a response as the problem still prevails

Thanks
Re: excluding urls
« Reply #12 on: July 03, 2009, 05:36:48 PM »
any update?
Re: excluding urls
« Reply #13 on: July 04, 2009, 07:01:20 AM »
Hello,

possibly Google bot was not able to connect to your server, it is likely that your host also implemented a firewall rule that blocks (may be partially) google bot requests to reduce it's activity.

More details: http://www.homewithandrew.com/index.php/debugging-the-network-unreachable-robots-txt-unreachable-error/