VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks

Taehyung Lee; Young Ik Eom

doi:10.1109/IMCOM48794.2020.9001717

VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks

Taehyung Lee, Young Ik Eom

Department of Computer Science and Engineering

Sungkyunkwan University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

Virtualization supports multi-tenancy in the form of virtual machine (VM) and tends to oversubscribe hardware resources to improve resource utilization. However, this server consolidation comes at performance degradation, especially for latency-critical tasks. In such environments, a physical CPU (PCPU) is often time-shared by multiple virtual CPUs (VCPUs), and this time-sharing of PCPU limits guest OS-level supports for latency-critical (LC) tasks. To address this problem, this paper presents VCPU prioritization interface (VPI) that directly prioritizes the VCPU executing an LC task over other VCPUs hosting background ones. Our evaluation on real-world applications shows that VPI significantly reduces the average and 99th percentile latency of LC tasks by up to 66.6% and 60.5%, respectively.

Original language	English
Title of host publication	Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020
Editors	Sukhan Lee, Hyunseung Choo, Roslan Ismail
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728154534
DOIs	https://doi.org/10.1109/IMCOM48794.2020.9001717
State	Published - Jan 2020
Event	14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020 - Taichung, Taiwan, Province of China Duration: 3 Jan 2020 → 5 Jan 2020

Publication series

Name	Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020

Conference

Conference	14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020
Country/Territory	Taiwan, Province of China
City	Taichung
Period	3/01/20 → 5/01/20

Keywords

hypercall
latency-critical task
VCPU

Access to Document

10.1109/IMCOM48794.2020.9001717

Cite this

Lee, T., & Eom, Y. I. (2020). VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks. In S. Lee, H. Choo, & R. Ismail (Eds.), Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020 Article 9001717 (Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IMCOM48794.2020.9001717

Lee, Taehyung ; Eom, Young Ik. / VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks. Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020. editor / Sukhan Lee ; Hyunseung Choo ; Roslan Ismail. Institute of Electrical and Electronics Engineers Inc., 2020. (Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020).

@inproceedings{8cc8a8b0e046409dacba5a5b8260e59e,

title = "VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks",

abstract = "Virtualization supports multi-tenancy in the form of virtual machine (VM) and tends to oversubscribe hardware resources to improve resource utilization. However, this server consolidation comes at performance degradation, especially for latency-critical tasks. In such environments, a physical CPU (PCPU) is often time-shared by multiple virtual CPUs (VCPUs), and this time-sharing of PCPU limits guest OS-level supports for latency-critical (LC) tasks. To address this problem, this paper presents VCPU prioritization interface (VPI) that directly prioritizes the VCPU executing an LC task over other VCPUs hosting background ones. Our evaluation on real-world applications shows that VPI significantly reduces the average and 99th percentile latency of LC tasks by up to 66.6\% and 60.5\%, respectively.",

keywords = "hypercall, latency-critical task, VCPU",

author = "Taehyung Lee and Eom, \{Young Ik\}",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020 ; Conference date: 03-01-2020 Through 05-01-2020",

year = "2020",

month = jan,

doi = "10.1109/IMCOM48794.2020.9001717",

language = "English",

series = "Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

editor = "Sukhan Lee and Hyunseung Choo and Roslan Ismail",

booktitle = "Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020",

}

Lee, T & Eom, YI 2020, VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks. in S Lee, H Choo & R Ismail (eds), Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020., 9001717, Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020, Institute of Electrical and Electronics Engineers Inc., 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020, Taichung, Taiwan, Province of China, 3/01/20. https://doi.org/10.1109/IMCOM48794.2020.9001717

VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks. / Lee, Taehyung; Eom, Young Ik.
Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020. ed. / Sukhan Lee; Hyunseung Choo; Roslan Ismail. Institute of Electrical and Electronics Engineers Inc., 2020. 9001717 (Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks

AU - Lee, Taehyung

AU - Eom, Young Ik

PY - 2020/1

Y1 - 2020/1

N2 - Virtualization supports multi-tenancy in the form of virtual machine (VM) and tends to oversubscribe hardware resources to improve resource utilization. However, this server consolidation comes at performance degradation, especially for latency-critical tasks. In such environments, a physical CPU (PCPU) is often time-shared by multiple virtual CPUs (VCPUs), and this time-sharing of PCPU limits guest OS-level supports for latency-critical (LC) tasks. To address this problem, this paper presents VCPU prioritization interface (VPI) that directly prioritizes the VCPU executing an LC task over other VCPUs hosting background ones. Our evaluation on real-world applications shows that VPI significantly reduces the average and 99th percentile latency of LC tasks by up to 66.6% and 60.5%, respectively.

AB - Virtualization supports multi-tenancy in the form of virtual machine (VM) and tends to oversubscribe hardware resources to improve resource utilization. However, this server consolidation comes at performance degradation, especially for latency-critical tasks. In such environments, a physical CPU (PCPU) is often time-shared by multiple virtual CPUs (VCPUs), and this time-sharing of PCPU limits guest OS-level supports for latency-critical (LC) tasks. To address this problem, this paper presents VCPU prioritization interface (VPI) that directly prioritizes the VCPU executing an LC task over other VCPUs hosting background ones. Our evaluation on real-world applications shows that VPI significantly reduces the average and 99th percentile latency of LC tasks by up to 66.6% and 60.5%, respectively.

KW - hypercall

KW - latency-critical task

KW - VCPU

UR - https://www.scopus.com/pages/publications/85081133260

U2 - 10.1109/IMCOM48794.2020.9001717

DO - 10.1109/IMCOM48794.2020.9001717

M3 - Conference contribution

AN - SCOPUS:85081133260

T3 - Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020

BT - Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020

A2 - Lee, Sukhan

A2 - Choo, Hyunseung

A2 - Ismail, Roslan

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020

Y2 - 3 January 2020 through 5 January 2020

ER -

Lee T, Eom YI. VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks. In Lee S, Choo H, Ismail R, editors, Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9001717. (Proceedings of the 2020 14th International Conference on Ubiquitous Information Management and Communication, IMCOM 2020). doi: 10.1109/IMCOM48794.2020.9001717

VCPU Prioritization Interface for Improving the Performance of Latency-Critical Tasks

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this