Do you remember the old GUROchan archives (the one back in the .net days, called something like orz.gurochan.net, I forget) where every thread, deleted or otherwise, was listed on a giant page? If something like that can be done again with all threads rather than holding a static snapshot of only the last state of the site, it would make things easier. Then all the archives could be condensed into one.