Coupling Decentralized Key-Value Stores with Erasure Coding
|Title:||Coupling Decentralized Key-Value Stores with Erasure Coding|
|Date:||November 15, 2019 (Friday)|
|Time:||4:00 pm - 5:00 pm|
|Venue:||Room 121, 1/F, Ho Sin-Hang Engineering Building, The Chinese University of Hong Kong, Shatin, N.T.|
|Speaker:|| Prof. Patrick Lee Pak Ching
Associate Professor Department of Computer Science and Engineering The Chinese University of Hong Kong
Modern decentralized key-value stores often replicate and distribute data via consistent hashing for availability and scalability. Compared to replication, erasure coding is a promising redundancy approach that provides availability guarantees at much lower cost. However, when combined with consistent hashing, erasure coding incurs a lot of parity updates during scaling (i.e., adding or removing nodes) and cannot efficiently handle degraded reads caused by scaling. We propose a novel erasure coding model called FragEC, which incurs no parity updates during scaling. We further extend consistent hashing with multiple hash rings to enable erasure coding to seamlessly address degraded reads during scaling. We realize our design as an in-memory key-value store called ECHash, and conduct testbed experiments on different scaling workloads in both local and cloud environments. We show that ECHash achieves better scaling performance (in terms of scaling throughput and degraded read latency during scaling) over the baseline erasure coding implementation, while maintaining high basic I/O and node repair performance.
Patrick Lee is now an Associate Professor at CUHK CSE. Please refer to http://www.cse.cuhk.edu.hk/~pclee.
Enquiries: Ms. Shirley Lau at tel. 3943 8439
For more information, please refer to http://www.cse.cuhk.edu.hk/en/events