Philly ETE # 37 – Not-So-Big Data After All: Managing Reference Data with Sirius – Jon Moore

by
Tags: , ,
Category:

PlayPlay

From the abstract: Many interesting “reference datasets” now fit in a single commodity server’s RAM, with more on the way as main memory sizes continue to grow. The open source Sirius library allows developers access to this data in native datastructures while managing the distributed systems heavy lifting of replication and persistence.

In this talk, I’ll describe what “reference data” means so that you can recognize this common use case in your own applications, highlighting problems that Sirius is a good fit for (and those that it isn’t). I’ll describe the overall architecture of a Sirius-based application—-the high-level concept of how it works. Finally, I’ll use a case study from Comcast as an example where Sirius is powering applications serving tens of millions of customers.