HiPower: A High-performance RDMA Acceleration Solution for Distributed Transaction Processing

EasyChair Preprint no. 1302

Abstract

The increasing complex tasks and growing size of data have necessitated the application of distributed transaction processing (DTP), which decouples tasks and data among multiple nodes for jointly processing. However, compared with the revolutionary development of computation power, the network capability falls relatively behind, leaving communication as a more distinct bottleneck. This paper focuses on the recent emerging RDMA technology, which can greatly improve communication performance but cannot be well exploited in many cases due to improper interactive design between the requester and responder. Our research finds that the typical implementation of confirming per work request (CPWR) triggers considerable CPU involvement, which further degrades the overall performance of RDMA communication. Targeting at this, we propose HiPower, which leverages a batched confirmation scheme with lower CPU utilization, to improve high-frequency communication efficiency. Our experiments show that, compared with CPWR, HiPower can improve the communication efficiency by up to 75% and reduce CPU cost by up to 79%, which speeds up the overall FCT (Flow Completion Time) by up to 14% on real workflow(Resnet-152). 

Keyphrases: Batched confirmation, distributed transaction processing, One-by-one confirmation, RDMA

@Booklet{EasyChair:1302,
  author = {Runhua Zhang and Yang Cheng and Jinkun Geng and Shuai Wang and Kaihui Gao and Guowei Shen},
  title = {HiPower: A High-performance RDMA Acceleration Solution for Distributed Transaction Processing},
  howpublished = {EasyChair Preprint no. 1302},

  year = {EasyChair, 2019}}