X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing

Shixiong Qi; Han Sing Tsai; Yu Sheng Liu; K. K. Ramakrishnan; Jyh Cheng Chen

doi:10.1109/NetSoft57336.2023.10175428

X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing

Shixiong Qi, Han Sing Tsai, Yu Sheng Liu, K. K. Ramakrishnan, Jyh Cheng Chen

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.

Original language	English
Title of host publication	2023 IEEE 9th International Conference on Network Softwarization
Subtitle of host publication	Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings
Editors	Carlos J. Bernardos, Barbara Martini, Elisa Rojas, Fabio Luciano Verdi, Zuqing Zhu, Eiji Oki, Helge Parzyjegla
Pages	107-115
Number of pages	9
ISBN (Electronic)	9798350399806
DOIs	https://doi.org/10.1109/NetSoft57336.2023.10175428
State	Published - 2023
Event	9th IEEE International Conference on Network Softwarization, NetSoft 2023 - Madrid, Spain Duration: Jun 19 2023 → Jun 23 2023

Publication series

Name	2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings

Conference

Conference	9th IEEE International Conference on Network Softwarization, NetSoft 2023
Country/Territory	Spain
City	Madrid
Period	6/19/23 → 6/23/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Funding

ACKNOWLEDGMENT We thank the US NSF for their generous support through grant CRI-1823270. This work was also supported in part by the National Science and Technology Council of Taiwan under grant numbers 111-2221-E-A49-093-MY3, 111-2218-E-A49-023, and 111-3114-E-A49-001. We thank Poyi Lin of National Yang Ming Chiao Tung University, Taiwan, for his help in the implementation.

Funders	Funder number
National Science Foundation Arctic Social Science Program	CRI-1823270
National Science and Technology Council	111-3114-E-A49-001, 111-2221-E-A49-093-MY3, 111-2218-E-A49-023

Keywords

communication in service function chains
DPDK
shared memory
unified I/O interface

ASJC Scopus subject areas

Computer Networks and Communications
Signal Processing
Software

Access to Document

10.1109/NetSoft57336.2023.10175428

Cite this

Qi, S., Tsai, H. S., Liu, Y. S., Ramakrishnan, K. K., & Chen, J. C. (2023). X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing. In C. J. Bernardos, B. Martini, E. Rojas, F. L. Verdi, Z. Zhu, E. Oki, & H. Parzyjegla (Eds.), 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings (pp. 107-115). (2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings). https://doi.org/10.1109/NetSoft57336.2023.10175428

Qi, Shixiong ; Tsai, Han Sing ; Liu, Yu Sheng et al. / X-IO : A High-performance Unified I/O Interface using Lock-free Shared Memory Processing. 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings. editor / Carlos J. Bernardos ; Barbara Martini ; Elisa Rojas ; Fabio Luciano Verdi ; Zuqing Zhu ; Eiji Oki ; Helge Parzyjegla. 2023. pp. 107-115 (2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings).

@inproceedings{e29e0e977367485880cf364837fcde7b,

title = "X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing",

abstract = "Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.",

keywords = "communication in service function chains, DPDK, shared memory, unified I/O interface",

author = "Shixiong Qi and Tsai, {Han Sing} and Liu, {Yu Sheng} and Ramakrishnan, {K. K.} and Chen, {Jyh Cheng}",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 9th IEEE International Conference on Network Softwarization, NetSoft 2023 ; Conference date: 19-06-2023 Through 23-06-2023",

year = "2023",

doi = "10.1109/NetSoft57336.2023.10175428",

language = "English",

series = "2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings",

pages = "107--115",

editor = "Bernardos, {Carlos J.} and Barbara Martini and Elisa Rojas and Verdi, {Fabio Luciano} and Zuqing Zhu and Eiji Oki and Helge Parzyjegla",

booktitle = "2023 IEEE 9th International Conference on Network Softwarization",

}

Qi, S, Tsai, HS, Liu, YS, Ramakrishnan, KK & Chen, JC 2023, X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing. in CJ Bernardos, B Martini, E Rojas, FL Verdi, Z Zhu, E Oki & H Parzyjegla (eds), 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings. 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings, pp. 107-115, 9th IEEE International Conference on Network Softwarization, NetSoft 2023, Madrid, Spain, 6/19/23. https://doi.org/10.1109/NetSoft57336.2023.10175428

X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing. / Qi, Shixiong; Tsai, Han Sing; Liu, Yu Sheng et al.
2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings. ed. / Carlos J. Bernardos; Barbara Martini; Elisa Rojas; Fabio Luciano Verdi; Zuqing Zhu; Eiji Oki; Helge Parzyjegla. 2023. p. 107-115 (2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - X-IO

T2 - 9th IEEE International Conference on Network Softwarization, NetSoft 2023

AU - Qi, Shixiong

AU - Tsai, Han Sing

AU - Liu, Yu Sheng

AU - Ramakrishnan, K. K.

AU - Chen, Jyh Cheng

PY - 2023

Y1 - 2023

N2 - Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.

AB - Cloud-native microservice applications use different communication paradigms to network microservices, including both synchronous and asynchronous I/O for exchanging data. Existing solutions depend on kernel-based networking, incurring significant overheads. The interdependence between microservices for these applications involves considerable communication, including contention between multiple concurrent flows or user sessions. In this paper, we design X-IO, a high-performance unified I/O interface that is built on top of shared memory processing with lock-free producer/consumer rings, eliminating kernel networking overheads and contention. X-IO offers a feature-rich interface. X-IO's zero-copy interface supports building provides truly zero-copy data transfers between microservices, achieving high performance. X-IO also provides a POSIX-like socket interface using HTTP/REST API to achieve seamless porting of microservices to X-IO, without any change to the application code. X-IO supports concurrent connections for microservices that require distinct user sessions operating in parallel. Our preliminary experimental results show that X-IO's zero-copy interfaces achieve 2.8x-4.1x performance improvement compared to kernel-based interfaces. Its socket interfaces outperform kernel TCP sockets and achieve performance close to UNIX-domain sockets. The HTTP/REST APIs in X-IO perform 1.4 x-2.3 x better than kernel-based alternatives with concurrent connections.

KW - communication in service function chains

KW - DPDK

KW - shared memory

KW - unified I/O interface

UR - http://www.scopus.com/inward/record.url?scp=85166474657&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85166474657&partnerID=8YFLogxK

U2 - 10.1109/NetSoft57336.2023.10175428

DO - 10.1109/NetSoft57336.2023.10175428

M3 - Conference contribution

AN - SCOPUS:85166474657

T3 - 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings

SP - 107

EP - 115

BT - 2023 IEEE 9th International Conference on Network Softwarization

A2 - Bernardos, Carlos J.

A2 - Martini, Barbara

A2 - Rojas, Elisa

A2 - Verdi, Fabio Luciano

A2 - Zhu, Zuqing

A2 - Oki, Eiji

A2 - Parzyjegla, Helge

Y2 - 19 June 2023 through 23 June 2023

ER -

Qi S, Tsai HS, Liu YS, Ramakrishnan KK, Chen JC. X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing. In Bernardos CJ, Martini B, Rojas E, Verdi FL, Zhu Z, Oki E, Parzyjegla H, editors, 2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings. 2023. p. 107-115. (2023 IEEE 9th International Conference on Network Softwarization: Boosting Future Networks through Advanced Softwarization, NetSoft 2023 - Proceedings). doi: 10.1109/NetSoft57336.2023.10175428

X-IO: A High-performance Unified I/O Interface using Lock-free Shared Memory Processing

Abstract

Publication series

Conference

Bibliographical note

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this