Intelligent Resource Management in Peer-to-Peer Overlays
Emin Gun Sirer
In this talk, I will describe a new resource management framework that enables distributed systems to be built with strong performance and resource usage guarantees. The critical insight behind this framework, called Honeycomb, is to formalize the core tradeoffs in distributed systems as a mathematical optimization problem. The framework then provides strong performance and resource usage guarantees by minimizing a targeted cost function subject to constraints in a distributed fashion.
I will outline the Honeycomb framework and describe how we recently applied it to build three peer-to-peer systems: CoDoNS, a replacement for DNS, CobWeb, an open-access content distribution network like Akamai, and Corona, an RSS-like system for disseminating Web micronews. All three systems have been deployed on PlanetLab, and either guarantee near-optimal lookup/update performance subject to bandwidth constraints or achieve a targeted level of lookup/update performance while minimizing bandwidth and storage costs. Overall, Honeycomb represents a novel approach to building large-scale distributed systems that contrasts with past systems based on ad hoc heuristics for resource management.