While CPUs have gotten much faster (60%/year), memory hasn't kept up (barely 10%/year). Most programs spend much of their time moving data around in memory, because common programming styles lead to data that is extremely fragmented (poor locality) - memory is the bottleneck, not processor speeds.

http://seven-degrees-of-freedom.blogspot.com/2009/10/latency...