Buttercola: System Design: Introduction to Giraph
https://www.youtube.com/watch?v=l4nQjAG6fac
https://www.youtube.com/watch?v=xyvs7NQdfZk
Apache Giraph is an iterative graph processing system built for high scalability. For example, it is currently used at Facebook to analyze the social graph formed by users and their connections. Giraph originated as the open-source counterpart to Pregel, the graph processing architecture developed at Google and described in a 2010 paper. Both systems are inspired by the Bulk Synchronous Parallel model of distributed computation introduced by Leslie Valiant. Giraph adds several features beyond the basic Pregel model, including master computation, sharded aggregators, edge-oriented input, out-of-core computation, and more. With a steady development cycle and a growing community of users worldwide, Giraph is a natural choice for unleashing the potential of structured datasets at a massive scale.
3. Bulk Synchronous Parallel Moel (BSP):
Read full article from Buttercola: System Design: Introduction to Giraph
https://www.youtube.com/watch?v=xyvs7NQdfZk
Apache Giraph is an iterative graph processing system built for high scalability. For example, it is currently used at Facebook to analyze the social graph formed by users and their connections. Giraph originated as the open-source counterpart to Pregel, the graph processing architecture developed at Google and described in a 2010 paper. Both systems are inspired by the Bulk Synchronous Parallel model of distributed computation introduced by Leslie Valiant. Giraph adds several features beyond the basic Pregel model, including master computation, sharded aggregators, edge-oriented input, out-of-core computation, and more. With a steady development cycle and a growing community of users worldwide, Giraph is a natural choice for unleashing the potential of structured datasets at a massive scale.
3. Bulk Synchronous Parallel Moel (BSP):
- Computation consists of a series of super steps
- Superstep is an atomic unit of computation where operations can happen in parallel
- During a superstep, components are assigned tasks and receive unordered messages from previous superstep.
- Components communicate through point-to-point messaging.
- All (or a subset of) components can be synchronized through the superstep concept
Read full article from Buttercola: System Design: Introduction to Giraph
