Not crawling
« on: July 15, 2009, 05:58:37 PM »
I am not sure if there is a problem with the script or my site.

I recently changed over from a static HTML site to one that includes dynamic PHP content. Let's say the home page is [ External links are visible to forum administrators only ]. The script starts to crawl, but no URLs are returned. However when I rename the home page to index.htm it crawls hundreds of pages but only lists those with a .htm extension and none with a .php extension.

Re: Not crawling
« Reply #2 on: July 16, 2009, 02:14:29 PM »
PM with URL sent...