SiteMap Generator is skipping URL's
« on: February 24, 2017, 08:02:49 PM »
Hello,
I purchased SiteMap Generator and Installed on my server and everything work great but
SiteMap Generator is skipping 700 URL's   :(

I put the Maximum depth level on "0" but not helping!

Please help me with this issue!

Thanks,
Martin
Re: SiteMap Generator is skipping URL's
« Reply #1 on: February 25, 2017, 10:45:25 AM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
Re: SiteMap Generator is skipping URL's
« Reply #2 on: February 25, 2017, 05:03:50 PM »
[ External links are visible to forum administrators only ]
Re: SiteMap Generator is skipping URL's
« Reply #3 on: February 25, 2017, 05:06:50 PM »
Example:

[ External links are visible to forum administrators only ]


all profiles in directory can be reach from footer directory menu
There is over 600 profiles but sitemap just get 10 !
Re: SiteMap Generator is skipping URL's
« Reply #4 on: February 26, 2017, 04:50:29 PM »
Hello,

directory pagination on your website is handled using javascript, in order to index these pages it must comply with ajax crawling specs:
https://developers.google.com/webmasters/ajax-crawling/docs/getting-started
Re: SiteMap Generator is skipping URL's
« Reply #5 on: February 26, 2017, 10:07:24 PM »
Hello,
Thanks for your reply!
I'm trying o fix that otherwise I have to change this sitemap generator!
My old generator works perfectly with all these urls!

BTW

I also get this error during crawling:

Gateway Timeout
The gateway did not receive a timely response from the upstream server or application.

Additionally, a 504 Gateway Timeout error was encountered while trying to use an ErrorDocument to handle the request.
Re: SiteMap Generator is skipping URL's
« Reply #6 on: February 27, 2017, 06:09:02 AM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.