dynamic site standalone generator
« on: November 08, 2007, 01:34:54 AM »
I hv a dynamic site that creates pages via the url.
Various settings on SG standalone get between 1 and 150,000 pages on the sitemaps  ;D.
Difficulty  w/  generated sitemaps staying on subject at deeper levels ???
Are there any wildcards allowed in "include only" urls, are partial includes allowed such as "hollywood_movie" ? multiple urls?   :P
The maximum execution time is exceeded for the jobs. Is the max per page? site?
Re: dynamic site standalone generator
« Reply #1 on: November 08, 2007, 11:43:43 PM »

yes, you can specify a desired substring in "Include only" option to indexed only selected pages.
Also, you can specify other pages substring for "Do not parse" option to skip them from crawling.