The NPUG web site features a vBulletin forum and when Google Sitemapper reaches the forums, it just crawls and crawls and crawls. For example, yesterday it crawled the forums for 10 hours until I finally cancelled the process and killed the application.
I'd like to include the forum in the sitemap, but it doesn't need to crawl every single page of the forums either. Anyone have any suggestions how how I can tweak the options for dealing with vB?
Thanks in advance!