Publication
Distributed GPU Joins on Fast RDMA-capable Networks
Lasse Thostrup; Gloria Doci; Nils Boeschen; Manisha Luthra; Carsten Binnig
In: Proceedings of the ACM on Management of Data (PACMMOD), Vol. 1, No. 1, Pages 29:1-29:26, Association for Computing Machinery (ACM), 2023.
Abstract
In this paper, we present a novel pipelined GPU join that accelerates the performance of distributed DBMSs by leveraging GPU resources on fast networks. A key insight is that we enable pipelined join execution by overlapping the network shuffling with the build and probe phases, thereby significantly reducing the GPU idle time. To demonstrate this, we propose novel algorithms for distributed pipelined GPU joins with RDMA and GPUDirect for both arbitrarily large probe- and build-side tables. In our evaluation, we show our pipelined distributed GPU join can reduce the overall runtime of a full query by up to 6× against a state-of-the-art CPU-only join.