Only crawling a small number of pages
« on: January 29, 2021, 01:43:39 PM »
Here is an example of some pages that are not parsed...

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

Any help would be appreciated.

Chris
Re: Only crawling a small number of pages
« Reply #1 on: January 30, 2021, 09:30:01 AM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: Only crawling a small number of pages
« Reply #2 on: February 01, 2021, 11:00:50 PM »
I figured it out...I remove the www from all the links in the sites main menu.

Re: Only crawling a small number of pages
« Reply #3 on: February 03, 2021, 04:37:49 PM »
I'm glad you got this resolved!