Reference : Benchmarking Synchronous and Asynchronous Stream Processing Systems
Scientific congresses, symposiums and conference proceedings : Paper published in a book
Engineering, computing & technology : Computer science
http://hdl.handle.net/10993/45325
Benchmarking Synchronous and Asynchronous Stream Processing Systems
English
Ellampallil Venugopal, Vinu mailto [University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS) >]
Theobald, Martin mailto [University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS) >]
2-Jan-2020
Benchmarking Synchronous and Asynchronous Stream Processing Systems
Ellampallil Venugopal, Vinu mailto
Theobald, Martin mailto
ACM
322-323
Yes
Yes
International
Esch-sur-Alzette
Luxembourg
7th ACM IKDD CoDS and 25th COMAD
from 02-01-2020 to 04-01-2020
ACM
[en] Stream data processing ; Big Data ; sustainable-throughput
[en] Processing high-throughput data-streams has become a major challenge in areas such as real-time event monitoring, complex dataflow processing, and big data analytics. While there has been tremendous progress in distributed stream processing systems in the past few years, the high-throughput and low-latency (a.k.a. high sustainable-throughput) requirement of modern applications is pushing the limits of traditional data processing infrastructures. To understand the upper bound of the maximum sustainable throughput that is possible for a given node configuration, we have designed multiple hard-coded multi-threaded processes (called ad-hoc dataflows) in C++ using Message Passing Interface (MPI) and Pthread libraries. Our preliminary results show that our ad-hoc design on average is 5.2 times better than Flink and 9.3 times better than Spark.
University of Luxembourg - UL
Researchers ; General public
http://hdl.handle.net/10993/45325
10.1145/3371158.3371206
https://dl.acm.org/doi/abs/10.1145/3371158.3371206

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Limited access
comad_authorscopy.pdfAuthor preprint353.15 kBRequest a copy

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.