Skipped URLs for no reason
« on: April 19, 2013, 03:05:52 PM »
Hi!

I noticed some pages not appearing in the sitemap. But I found it in the changelog for that crawling under the "Skipped URLs - crawled but not added in sitemap" section.

I read that in that list you have "URL - Reason for skipping", but there is no reason any page. Some of the 204 skipped URLs have " - lu" after the URL but I have no idea what does it mean either.

In the configuration, the "Exclude URLs" is empty.

I litteraly have no clue on what's going on. Any help will be appreciated.

Thanks!
Re: Skipped URLs for no reason
« Reply #2 on: April 23, 2013, 03:58:28 PM »
Here are some examples of that list. URLs that should be on the sitemap, but intead are on this list.

Quote
grocery-coupons-bundler/ -
coupons/ -
family-pets -
coupons/family-pets/clothing -
coupons/electronics-computers -
coupons/entertainment-leisure -
coupons/home-garden -
myaccount - lu
logout - lu
grocery-coupons-bundler -
coupons -
family-pets/ -
myaccount/ - lu
category/85/buying-a-car.html - lu
category/86/car-rentals.html - lu
category/88/maintenance-repairs.html - lu
category/87/gasoline.html - lu
category/84/auto-insurance.html - lu
category/76/98/cell-phones-plans.html - lu
Re: Skipped URLs for no reason
« Reply #4 on: April 25, 2013, 03:58:59 PM »
[ External links are visible to forum administrators only ]
Re: Skipped URLs for no reason
« Reply #5 on: April 30, 2013, 12:01:04 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: Skipped URLs for no reason
« Reply #6 on: February 11, 2014, 04:31:59 PM »
Is this solved?
I have the same problem.
Including the text LU added in the log.

There are about 50 URL's not added in the sitemap.
Why?
Re: Skipped URLs for no reason
« Reply #8 on: February 11, 2014, 06:09:15 PM »
Here are some.

een-bestelling-plaatsen-ip-161.html - lu - [ External links are visible to forum administrators only ]
informatie-kopen-rekening-ip-169.html - lu - [ External links are visible to forum administrators only ]
Re: Skipped URLs for no reason
« Reply #9 on: February 11, 2014, 06:24:24 PM »
Hello,

you have canonical meta tags on those pages pointing to a different URL.
Re: Skipped URLs for no reason
« Reply #10 on: February 11, 2014, 06:48:42 PM »
I checked the meta. The urls in there are the same as posted above.
Do you see different urls as I?

I don't understand...
Re: Skipped URLs for no reason
« Reply #11 on: February 11, 2014, 07:24:21 PM »
Just now I have even removed all canonical tags of my website.
Crawled the site.
And what happenend?

Still the same 50 pages not in the sitemap...
Re: Skipped URLs for no reason
« Reply #12 on: February 12, 2014, 06:51:29 AM »
Hello,

please let me know your generator URL/login in private message to check this.