
On 2012-06-14 6:15 AM, Brian Warner wrote:
The "entire world as one community" case is what we call the "one grid to rule them all". There are a lot of engineering/scaling challenges to it (you need log(N) DHTs, supernodes), in addition to features needed by a mass-market product if you want that kind of scale (NAT handling, bandwidth limiting, automatic update, nice UI, easy installation, etc, etc).
On 2012-06-14 6:26 AM, Brian Warner wrote:
Oh, one other thought: another challenge of Mojo Nation was that each file involved hundreds or thousands of backend blocks, and the overhead of finding/tracking/downloading all of them was pretty bad. If I remember right, the blocks came in fixed sizes (powers of two, up to maybe 1MB), and each included a little bit of data about all segments of the file (to avoid the "chunking" reliability problem). The result was high alacrity (you had to download the whole file before any part of it became readable, so no streaming) and really bad disk IO patterns on both upload and download.
This challenge, and its solution, (DHT, host discovery) corresponds to a bittorrent magnet link, and the software that makes such links work. This may well be the most widely used form of file sharing, so the way to go is likely some kind of superset of this existing solution, if we think of the task to solved as file sharing. _______________________________________________ tahoe-dev mailing list tahoe-dev@tahoe-lafs.org https://tahoe-lafs.org/cgi-bin/mailman/listinfo/tahoe-dev ----- End forwarded message ----- -- Eugen* Leitl <a href="http://leitl.org">leitl</a> http://leitl.org ______________________________________________________________ ICBM: 48.07100, 11.36820 http://www.ativel.com http://postbiota.org 8B29F6BE: 099D 78BA 2FD3 B014 B08A 7779 75B0 2443 8B29 F6BE