I noticed all of the forum threads have urls that are listed 1 to 230000.
So I wrote a program to create a text file with a list of all of the urls.
This would be the first page of every thread on the forum.
I then used the SingleFile plugin on Firefox to download all of the urls.
This took like a week or more day and night.
I then wrote a program that would read all of the downloaded pages, figure out the thread title, and forum category, sort them into the appropriate folders, and add an index url for that page in that category's index.
This was a little convoluted and the processing took about another week or more.
It wasn't just a matter of downloading but also indexing the forum.
Then I wrote a program to read all of the pages and to zero out public profile button links.
I then wrote a program to read all of those sorted thread pages, and figure out if those threads have additional pages, and create a big list of urls for those additional pages to be downloaded.
There was about a week of processing for this.
I then used the SingleFile plugin to download these pages.
Probably a few days to do this.
Then I wrote a program to read all of these pages, and sort them correctly with the already sorted pages.
That took a few more days around the clock.
Then I wrote a program to read all of the sorted thread pages, figure out if the thread has multiple pages, and modify the page links in the html to point to each other, so you can flip through the pages.
This took a few days.
Then I wrote a program to insert a line of javascript into each page restoring the codeblock functionality.
-=-=-=-
This is an over simplification, since there was a lot more screwing around and backtracking to fix problems, then enhancing with one improvement over another.
It's basically been a 24/7 processing job from about Feb 18 to March 3. Just flipping through thread html files as fast as possible to process, and sort things.
Then each time it was all zipped up was like a 12 hour job.
It's also why if I have to fix something it takes like 3-7 days.