Monday, June 10, 2013

A Note on PRISM and IOPS

I have several posts half-written on the subject of the NSA's data-gathering efforts, but let me start with a few words on which things in the computing world are and are not subject to "Moore's Law".

Let's first say that the real Moore's Law is a narrow statement about the rate of increase in the number of transistors per integrated circuit, but in its colluqial usage means something like "computing power per unit cost increases exponentially, doubling about once every 18-24 months" That is, if I buy $1 million worth of computing power today, and then 2 years later spend another (inflation-adjusted) $1 million on computing power, the newer computer will be roughly twice as "powerful" as the older one, for some definition of "powerful".

Moore's law cannot make this platter spin any faster.
Now let's talk about the fact that certain things happening inside your computer are physical processes that researchers have had a hard time getting onto the Moore's Law growth curve. Most importantly, large hard drives consist of platters that must be spun at higher and higher speeds in order to increase disk read & write performance.

Network bandwidth appears to be on a Moore's law-style curve, but the rate of growth is somewhat slower than, say, the growth in the amount of RAM you get for $100 or the amount of CPU power you get for $1000.

These facts turn out to be important because the amount of data supposedly being collected is large enough that it has to be kept on hard drives, as opposed to in RAM or even on solid-state drives. This has important consquences for our ability to do meaningful research on the raw data. But we'll cover that later.
Post a Comment