Giant Sitemap with Forum

[Keir]

Hi

I have phpBB3 installed and when I run the site-map for it I get over 3000 links and the site-map takes at least 15 minutes to generate. I'd like it to be quick and not have over 3000 links! I tried the method in the Crazed Sitemap topic which was to add Parse-Only URL's etc. I would like it just to generate the sitemap for my index, faq, members, topics and announcements

Thanks

[Keir]

Okay I just realised since giving it the parseonly etc it is about 5 minutes faster but how can I make it so it's super quick?

You could make it so that once it does a full scan then the next 5 times it only does topics inside the active threads search then after 5 times do a full scan?

Or is there an easier way?

[XML-Sitemaps Support]

Hello,

sitemap generator bot needs to scan all pages, otherwise it won't be able to find new ones.
Make sure that you use URL exclusion preset for phpBB, it will be very fast (including topics in sitemap directly, without parsing them).

[Keir]

Hello,

sitemap generator bot needs to scan all pages, otherwise it won't be able to find new ones.
Make sure that you use URL exclusion preset for phpBB, it will be very fast (including topics in sitemap directly, without parsing them).

Okay what else can I put in? This is what I have

Exclude URL's:

Code Select Expand


&pid=
&view=
&do=reply
&do=new
act=Post
act=Login
act=usercp
req=sendentry
op=reportcomment
show=next
req=syndicate
req=showarchive


Do Not parse URL's:

Code Select Expand


showuser=
&user=
do=stats
req=printentry
show=comment
showtopic=
showentry=
lofiversion/index.php/t
&img=


Sorry I got "parse-only urls" mixed up with "do not parse urls lol"

Thanks

[XML-Sitemaps Support]

It looks ok - topics are added directly due to "Do not parse" setting, assuming that you have default dynamic links for IPB (index.php?showtopic=XX)

[Keir]

It looks ok - topics are added directly due to "Do not parse" setting, assuming that you have default dynamic links for IPB (index.php?showtopic=XX)

Okay Thanks

[Keir]

Sorry to bump this thread but what are the "URL exclusion preset for phpBB"? Thanks

[XML-Sitemaps Support]

On sitemap generator config page you can find this:
Narrow Indexed Pages Set
->
Exclusion preset

In that dropdown select "phpBB" if you are using phpbb forum.

[Keir]

Thanks! Trying that now!