"Come for the food Stay because we know what you did"
We have tons of files about the video surveillance network in Chicago, double digit gigabytes. Most of the documents are easy to read, but as a whole body of records involve a technical deployment that takes place over years, and could only be easily or quickly parsed by the files' source and mostly creator, an IBM researcher.
Long-story short this researcher uploaded a hard drive wholesale without password protection or even a robots.txt, and Googlebot indexed it.
In a previous post I mentioned using a mind map to organize a structured directory of documents, you don't have to download the software to use the documents I'll be posting, but please keep this in mind, a key reason I am not just dumping a big zip file:
You will benefit from a much fuller understanding of what you read if you participate in the process of parsing its source corpus -- even if you want to make a docx outline with bullet points, one for each document perhaps, and then a child indention for components, analytic technology, application, and then sub-levels as appropriate.
You should also read whole documents as you go to inform your organization but the important point is ending up with the whole body of data in a consistent structure. This is most of the hard work on your way to higher-level data-mining and modeling with graphing software.
Right now I'm going to use a pretty basic approach, automating creation of a flow-chart template from the Chicago directory as I found it, with the exception of the last node on the second tier with children nodes, which are the document files in the top directory, I don't want them on the same level as the other directories for the structure purposes just mentioned. There are a lot of folders, the technical expertise involved in this process was the same as opening a document from the File tab in MS Word.
This folder (image/link)
became this mind map. See my tweets below and my previous blog post, I'll be updating regularly, in between doing stuff I have to do to eat...
http://blog.networkedinference.com/2017/01/also-about-video-surveillance-in....