[FoRK] Joyent, cloud service evolution (J. Andrew Rogers)
Stephen D. Williams
sdw at lig.net
Tue Jun 21 17:50:49 PDT 2016
That's what I expect in a lot of cases: tiers of communications concentrators / condensers / filters, then parallel I/O channels to
some kind of storage.
In some cases, you may not even want to store this kind of data on secondary storage: fan it into high speed data channels into a
big, fast memory. Then do operations on that. As an image even. So you can use GPUs. Replicate it a few times for different
kinds of analysis.
On 6/21/16 2:46 PM, Marty Halvorson wrote:
> After reading all this, I wonder what you'll think of how the CERN LHC collects data?
> Each experiment generates 10's of trillions of bit's per second. A reduction of up to 2 orders of magnitude is done in hardware,
> the result is sent via very high speed pipes to a huge number of PC's where a further reduction of 1 or 2 magnitudes is done.
> Finally, the data is stored for research purposes usually done on collections of supercomputers.
More information about the FoRK