>Hi to all in general and Jim in particular,
>I don't check the list all that often at the moment, I decided to do a keyword search after I saw your disqus comment. It's good to hear from you, I'm a fan of Assassination Politics. It's a thought provoking work describing a dangerous idea of the kind that has always fascinated me :)
>I'll repeat what I said in my reply on the page:
>Currently. Yes, the archive is basically just a clone of what's in the raw files hosted on Ryan Lackey's venona site. I strongly, strongly suspect that this has large amounts of missing data due to how quiet some periods are, and also it ends in early 1999 anyway (with those emails tacked on to the end of the 1998 archive).
While that would be an entirely plausible possibility in the general case, and over many years, I can assure you that the then-current almost-total data void from February 14 1995 through about mid-July 1995 have nothing at all to do with that idea. I was there at least during March 1995 through nearly half of 1997. My very existence, and that of references to "AP" and "Assassination Politics", was almost perfectly erased...except that it wasnt, in the 1996 archive. Even when emails were listed July 1995-December 1995, I was seemingly almost entirely 'erased', Even people today on CP see that the list must have been "sanitized" to within an inch of its life.
>I was provided with a (apparently) roughly complete archive for 2000 to 2016. This is hosted here currently:
>I had strong ambitions of trying to index and merge all of the archives I could get my hands on, but this is more challenging than you might think. Determining which two emails are the same is very difficult when they sometimes contain encoding errors, extra whitespace, differing text for expressing the time of emails, etc (making hashing an infeasible way of comparing them). I've also had an enormous amount of other commitments that have preventing me working on this archive as much as I'd like (or at all really, if I'm honest) over the past year.
Well, I think finding out what happened to the data archived into the 1995 will be much simpler than re-generating the full, correct archive. And no doubt this recently-discovered fraud will induce many more people to be interested in fixing the archive. So, you shouldn't worry that you will be faced with an ocean of work.
>The site is also a Jekyll-generated static site hosted on github. The sheer number of pages is really approaching the limit of what's possible with this approach. It takes over an hour to build the site currently. Adding the 2000-2016 archive would be totally unworkable in this way. I also want to index the messages in ElasticSearch or similar. The lack of a search function is something that I feel is sorely lacking.
>Sadly, for this reason, my attempts to synthesise all the available incomplete archives of messages from this era have stalled :( it's there at the back of my mind though, so I haven't lost the will to work on it, just the time.
Okay, I think things will change dramatically, and you will get help on this project, I am sure,
>I hear your concerns about large numbers of missing emails, and if anyone reading this has their own copies of the 1990s archives, I'd love to have them. I can't make any promises about when I'll be able to work on processing them, but rest assured I will take great care of those archive files so that, should I fail to complete this task myself, those archives will be collected together for someone else to attempt to finish the task.]
Understand my opinion that "finishing the archive", while remaining a worthy goal, should not be considered the highest priority now, As I said quite recently, you don't mow the grass when your house is burning down.
I think this needs to be extremely well-publicized, to attract the attention of Cypherpunks who frequented the list in the mid-1995s. We have their names, probably most of them, as they remain (in part?) in the archive. And most of their subsequent email addresses probably appear in later archive years. They may have archives of their own; now, they may have no idea that this old data is needed.
>Whether or not those archives have willful deletions or modifications to the data, I've no idea, to be honest.
Well, having examined and scanned the archive for 1995, I _do_ have an idea. Due to the essentially complete absence of an extremely peculiar pattern of data strings, such as "Jim Bell", "jimbell@pacifier.com", "ap", and "assassination politics", yet a few examples of ' ap ' in about 15 examples but only where it doesn't mean "assassination politics" " ap" meaning Associated Press, "killer ap", all this is an extremely specific 'fingerprint' pointing to not merely an automatic search-and-replace, but in fact a careful and precise manipulation of the data.
“It's circumstantial evidence, like finding a trout in the milk.”
"I would rely on others to notice and report things that seem strange."
But I'm sure you understand that unless such a person possesses specific knowledge about what happened during 1995 on the CP list, he is very unlikely to spontaneously notice the meaning behind the data as it now appears to be. Viewed in complete isolation, the virtually-complete data absence from February 14 to mid-July 1995 might 'look like" a simple omission of data, but the later absence of the strings above from July-December 1995 are far more unambiguous. Put simply, everybody who sees what is pointed out as the outcome will agree there must have been an amazing fraud perpetrated. I again express my well-educated opinion that the fraudster(s) very likely didn't actually forge any messages; rather he/they simply deleted threads and messages that contained references to me, my AP essay, and my then-current email address. The pattern is quite clear,.
"Even then I'm not sure what to do about it."
While it could be laughingly said that _I_, too, am not "sure" what to do about it, in extreme detail, I am quite confident that this is what constitutes approximately an "emergency". Let's see if anybody disagrees, I have already made many suggestions.
>When coming across two distinct versions of what appear to be the same message, I'd probably just list both. That's all I can do really. This project appears to be complex in a lot of ways that weren't obvious at the start... which is a familiar story to anyone who sets out to solve a problem I guess :)
Well, now you know enough about the truth that you can entirely change your point of view about this matter. More eyes need to be brought in to this matter, including ones who have actual memories of the CP events of 1995.
Tom