Sitemap Generator Forum

Hello,

I use to set my Links Depth to 150, but I want to change to a lower number.
If I set 10 for Links Depth, does this mean not all my contents will be crawled?

Also, by using a Lower Links depth number, reduce the time to complete the full Crawling ?

Hello,

that depends on type of website. "Depth level" means "how many clicks it takes to get to a specific page starting from homepage".

Hello XML Support,

Crawling is Frozen

I am trying to create my sitemap, that has over 200,000 Videos.
I am trying to to create the .XML sitemap and Video sitemap.

I sent a PM with my Generator Link

Already in progress. Current process state is displayed:

Links depth: 91
Current page: show/onde&ajax&p=88
Pages added to sitemap: 199999
Pages scanned: 200493 (5,419,937.8 KB)
Pages left: 1 (+ 303 queued for the next depth level)
Time passed: 14:48:47
Time left: 0:00:00
Memory usage: 152,724.4 Kb

My settings in PHP is are:

max_execution_time: 130000
memory_limit: 2028M


Can we Fix this and get my uncompleted Crawling to Finish, so I won;t have to Craw the site all over again please ?

Hello,

in case if you have lots of videos on the site it will take some time for generator to extract details for all of them via video APIs after crawling is finished.

Hello Support,

I need a fix for this. I delete all the data from /data/

Recreated the sitemap again with video sitemap, and now I get this. but after 8 hours this never finish.

Links depth: 51
Current page:
Pages added to sitemap: 167919
Pages scanned: 167928 (4,700,719.4 KB)
Pages left: (+ 0 queued for the next depth level)
Time passed: 10:52:02
Time left: 0:00:00
Memory usage:
Resuming the last session (last updated: 2014-08-13 03:09:59)
Completed

Total pages indexed: 167919
Creating sitemaps...
3%


This never END!!!

Hello,

replied to your PM.