XKeyscore rules - technology utilized

Nathan Andrew Fain nathan at squimp.com
Fri Jul 4 07:38:20 PDT 2014


Based on the xkeyscore rules does anyone have some idea of the
technology being utilized?

Looking at the mapreduce::plugin definition I get the impression
Hadoop is in use. Hadoop provides a stream interface for Map Reduce
functions letting one utilize any program or language of their
choosing [1-example]. Can with more knowledge of distributed data
technologies confirm this?

1.
http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C++_Programs_on_Hadoop
  see also slide 5:
  http://cecs.wright.edu/~tkprasad/courses/cs707/ProgrammingHadoop.pdf
<quote>
cat input | grep |     sort       | unique -c | cat > output
    Input |  Map | Shuffle & Sort | Reduce    | Output
</quote>



More information about the cypherpunks mailing list