Skip to main content Skip to main navigation

Publication

PANDA: performance prediction for parallel and dynamic stream processing

Pratyush Agnihotri; Boris Koldehofe; Carsten Binnig; Manisha Luthra
In: Yongluan Zhou; Panos K. Chrysanthis; Vincenzo Gulisano; Eleni Tzirita Zacharatou (Hrsg.). 16th ACM International Conference on Distributed and Event-based Systems. ACM International Conference on Distributed and Event-Based Systems (DEBS-2022), June 27-30, Copenhagen, Denmark, Pages 180-181, ACM, 2022.

Abstract

Distributed Stream Processing (DSP) systems highly rely on parallelism mechanisms to deliver high performance in terms of latency and throughput. Yet the development of such parallel systems altogether comes with numerous challenges. In this paper, we focus on how to select appropriate resources for parallel stream processing under the presence of highly dynamic and unseen workloads. We present PANDA that provides a novel learned approach for highly efficient and parallel DSP systems. The main idea is to provide accurate resource estimates and hence optimal using zero-shot cost models to ensure the performance demands.

More links