Crawled links

[islamicport]

I crwaled two  of my sites, once using the scipt installed at my server and once by your online script at www.xml-sitemaps.com.

first site
Your free script : crawled 435 url
My script : crawled 98 url only and gave completed message

second site :
your free script: crawled 431
My script : crawled 484 url

while in a third site it stops after crawling 2000 url, so I had to split crawling to crawl all my site.

Do yo have an explanation for this matter.
 
Thank you

[admin]

Hi,

1. Although both online generator and standalone script use the same crawler core, we're updating them separately from time to time, so there may be some difference The general to find out what wrong with listing is to find the URLs that are listed in one case and are not in other.
2. It is possible that crawling stops because the script can't extend the execution time. Although default php configuration allows to do it, some hosting environments disable this function and limit the exectution to certain time limit.