Skip to content

{ Category Archives } Uncategorized

Introducing the NIO SocketServer Implementation

Users of Voldemort have the option of using a binary protocol for efficient network communication between clients and nodes. This is implemented on the server side using an abstraction known as a SocketServer. Previously the only implementation of the voldemort.server.socket.SocketServer used the classic thread-per-socket blocking I/O approach to handling the network communication.
Recently my NIO implementation [...]

Building Voldemort read-only stores with Hadoop

A well-known lesson in scalability is that writes are 40x more expensive than reads and if your application becomes write-intensive as it is easily the case when you are dealing with sufficiently large number of users, you will be in trouble if you don’t design to scale. For example, if you are using MySQL, [...]

Tagged , ,

Building a terabyte-scale data cycle at LinkedIn with Hadoop and Project Voldemort

Many of LinkedIn’s products are critically dependent on computationally intensive data mining algorithms. Examples of these include some modules like People You May Know, Viewers of This Profile Also Viewed, and much of the Job matching functionality that we give to people who post jobs on the site. To support these data-intensive products we have [...]

Tagged , ,

Moved to github

By popular demand. Fork us.