generator does not do the whole site
« on: July 29, 2008, 05:03:14 PM »
[ External links are visible to forum administrators only ]

when i run the program it does not do the whole site

why ??
Re: generator does not do the whole site
« Reply #1 on: July 30, 2008, 03:27:19 PM »
Hello,

let me know an example URL that is not included in sitemap and how it can be reached starting from homepage.
Re: generator does not do the whole site
« Reply #2 on: July 30, 2008, 11:48:42 PM »
alshmalgate.net/main
not included
Re: generator does not do the whole site
« Reply #3 on: July 31, 2008, 03:47:49 PM »
When I click that link I'm redirected to:
Code: [Select]
http://www.yourdomain.net/main//home/alshmal/public_html/mainTry to add www. to the domain name in starting URL.
Re: generator does not do the whole site
« Reply #4 on: August 03, 2008, 11:41:38 PM »
[ External links are visible to forum administrators only ]
Re: generator does not do the whole site
« Reply #6 on: August 06, 2008, 07:48:49 PM »
[ External links are visible to forum administrators only ]

why the pages not added to the sitemap?
Re: generator does not do the whole site
« Reply #7 on: August 07, 2008, 05:00:07 PM »
You have "Create HTML Sitemap:" option disabled (that allows to save memory in case if it's limited), xml sitemap is created fine though:
Request date:
6 August 2008, 12:01
Processing time:
1287.40s
Pages indexed:
25519
Re: generator does not do the whole site
« Reply #8 on: August 07, 2008, 06:07:26 PM »
then what to do ????
Re: generator does not do the whole site
« Reply #10 on: August 16, 2008, 01:38:18 AM »
I have the same problem..

it seems the generator does not like ".htm" extensions.. but there are many pages that get omitted.

i use the "www" in the crawl setting.
Re: generator does not do the whole site
« Reply #11 on: August 16, 2008, 12:57:38 PM »
Hello,

there are no issues with indexing of *.htm pages, please let me know your generator URL and example page that is not included in sitemap and how it can be reched, starting from homepage.
Re: generator does not do the whole site
« Reply #12 on: August 16, 2008, 11:09:19 PM »
what is happining
[ External links are visible to forum administrators only ]

it was more than 25000 Page.
Now it is 22000 Page.
what is happining
« Reply #13 on: August 22, 2008, 09:12:19 PM »
what is happining
[ External links are visible to forum administrators only ]
it was more than 25000 Page.
Now it is 22000 Page

===============

and whay there is nothing in these URL

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
Re: generator does not do the whole site
« Reply #14 on: August 22, 2008, 09:46:53 PM »
Some links are automatically excluded - this is applied to "noise" content, like sorting links, login URLs, "send PM" etc.