Wednesday, January 2, 2013

Nutanix and MapReduce

So Nutanix relased the latest NOS 3.0 with all rich features. One of them that acutally hit me was the offline compression.

Mapreduce techniques to essentially figure out which data has gone cold and then compress it. the compression only occurs when the system is idle and data is cold, and determining when data is cold is left up to the user (e.g. after one day or after one hour). This technique is based on Google’s snappy compression library and hits a nice balance between high-speed & reasonable compression rate.