On this page, you can find information about my research and teaching activities. I also have a (rather information-sparse) personal website.
In am interested in the areas of operating systems and large scale distributed systems, and my work often incorporates and combines elements of both.
- CamSaS: Much of my work is part of
the Cambridge Systems at Scale (CamSaS)
effort to build a new systems software stack for large-scale data centres,
which I co-lead.
- DIOS: Modern data centres are "warehouse-scale computers", and users expect to see them as such. Yet, our operating systems have not changed in decades. As a result, a data centre machine's OS has no idea that it is part of a larger whole. DIOS is partly a revisit of old distributed operating system ideas in the context of modern data centres and partly a push for more scalable and well-integrated OS abstractions for "data-intensive" computing.
- Firmament: In "warehouse-scale" data centres, cluster and CPU schedulers are currently entirely separate and share no information. Firmament changes this: like Quincy, it models the entire data centre as a flow network and runs a fast solver to optimize over it. Unlike previous work, Firmament schedules tasks down to individual CPU cores, and deeply integrates local machine information with cluster-level concerns, yielding overall improved placement decisions in heterogenous environments.
Monolithic cluster scheduler architectures have difficulty keeping up with the
scale and diversity of modern data centre workloads. Omega adresses the need to
cater for this via parallelism, shared state, and lock-free optimistic
Omega supports highly heterogeneous schedulers sharing a single cluster's
resources without significant interference. This increases scalability and
offers the opportunity to rapidly build and deploy new schedulers.
This work was done during an internship at Google.
[EuroSys 2013 paper]
- I am also involved in the QJump project on bounded latency data centre networking [to appear at NSDI 2015], and the Musketeer project on dynamic generation of "big data" workflows [to appear at EuroSys 2015].
I also curate our database of inter-process communication performance (IPC) measurements, and run the NetOS group's weekly operating systems reading group, in which we read both seminal papers from the past and modern publications in the general area of OS research.
Once upton a time, I wrote my undergraduate dissertation in Computer Vision, investigating interactive 3D structure-from-motion.
- Musketeer: All for One, One for all in Data Processing Systems
Ionel Gog, Malte Schwarzkopf, Natacha Crooks, Matthew P. Grosvenor, Allen Clement and Steven Hand
to appear in Proceedings of the 10th European Conference on Computer Systems (EuroSys 2015)
» [to appear]
- Queues don't matter if you can JUMP them!
Matthew P. Grosvenor, Malte Schwarzkopf, Ionel Gog, Andrew W. Moore, Steven Hand and Jon Crowcroft
to appear in Proceedings of the 12th Symposium on Networked Systems Design and Implementation (NSDI 2015)
» [to appear]
- Raft Refloated: Do We Have Consensus?
Heidi Howard, Malte Schwarzkopf, Anil Madhavapeddy and Jon Crowcroft
ACM SIGOPS Operating Systems Review, Special Issue on Repeatability and Sharing of Experimental Artifacts. January 2015.
» Paper [to appear]
- New wine in old skins: the case for distributed operating systems
in the data center
Malte Schwarzkopf, Matthew P. Grosvenor and Steven Hand
in Proceedings of the 4th Asia-Pacific Workshop on Systems (APSYS 2013)
» Paper [ACM DL]
- Omega: flexible, scalable schedulers for large compute clusters
Malte Schwarzkopf, Andy Konwinski, Michael Abd-El-Malek and John Wilkes
in Proceedings of the 8th European Conference on Computer Systems (EuroSys 2013) – Best student paper award!
» Paper [ACM DL]
- The seven deadly sins of cloud computing research
Malte Schwarzkopf, Derek G. Murray and Steven Hand
in Proceedings of the 4th Workshop on Hot Topics in Cloud Computing (HotCloud 2012) at USENIX 2012
» Paper [usenix]
- Ciel: a universal execution engine for distributed data-flow computing
Derek G. Murray, Malte Schwarzkopf, Christopher Smowton, Steven Smith, Anil Madhavapeddy and Steven Hand
in Proceedings of the 8th USENIX Symposium on Networked System Design and Implementation (NSDI 2011)
» Paper [usenix]
A full list of my publications is available on the publications page.
Supervisions & teaching
Over the past years, I supervised a range of courses across all years of the Computer Science Tripos, with a focus on core systems courses.
In addition, I have supervised a number of undergraduate final year (Part II) projects, including three award-winning ones, and co-advised several masters projects.
Office phone: +44 1223 763683
University of Cambridge Computer Laboratory
Willam Gates Building
15 JJ Thomson Avenue
Cambridge CB3 0FD, UK