XKeyscore rules - technology utilized
Nathan Andrew Fain
nathan at squimp.com
Fri Jul 4 07:38:20 PDT 2014
Based on the xkeyscore rules does anyone have some idea of the
technology being utilized?
Looking at the mapreduce::plugin definition I get the impression
Hadoop is in use. Hadoop provides a stream interface for Map Reduce
functions letting one utilize any program or language of their
choosing [1-example]. Can with more knowledge of distributed data
technologies confirm this?
1.
http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C++_Programs_on_Hadoop
see also slide 5:
http://cecs.wright.edu/~tkprasad/courses/cs707/ProgrammingHadoop.pdf
<quote>
cat input | grep | sort | unique -c | cat > output
Input | Map | Shuffle & Sort | Reduce | Output
</quote>
More information about the cypherpunks
mailing list