Cambridge Systems at Scale (CamSaS)
Circe: big data workflow manager
Hadoop, Spark, PowerGraph, ...
Firmament: multi-level cluster scheduler
memcached, nginx, ...
DIOS: data-intensive operating system
CamIO: fast and flexible I/O
Linux / BSD OS
QJump: resilient, bounded-latency networking
Commodity network and servers
The Circe workflow manager runs workflows across multiple back-end frameworks, choosing the most optimal one automatically...
With QJump, we are bringing guaranteed latency communication to data centre networks...
Legacy OS abstractions from the 1970s do not scale to modern "warehouse-scale" data centres. DIOS is a new operating system designed for scalability and efficiency...
Using CamIO allows applications writers to focus on the important aspects of writing application logic whilst ignoring the complexities of I/O management...
Modern data centres, web applications and big data analytics require systems software to operate at unprecedented scale.
CamSaS is our initiative to build a systems software stack for the 21st century warehouse-scale data centres.
Fulgurator: an energy-aware extension for Firmament
Firmament has been extended with a new energy-aware scheduling policy that yields up to 20% power savings while maintaining SLAs in a highly heterogeneous ARM/x86 data centre environment.
Circe: now supporting Naiad
We have recently extended Circe with prototype support for Naiad, a new big data framework from Microsoft Research.
© 2013 University of Cambridge