Reducing garbage collection overhead of log-structured file systems with GC journaling

Hyunho Gwak; Yunji Kang; Dongkun Shin

doi:10.1109/ISCE.2015.7177770

Reducing garbage collection overhead of log-structured file systems with GC journaling

Hyunho Gwak
, Yunji Kang
, Dongkun Shin

Department of Computer Science and Engineering

Sungkyunkwan University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

The log-structured file system (LFS) writes all modifications to storage sequentially with append-only logging scheme. This characteristic of LFS is very advantageous to flash storages since the flash memory does not permit in-place overwrite. However, LFS has a high garbage collection (GC) overhead. In particular, under the lazy metadata update scheme, each GC process should invoke the high-cost checkpointing which flushes all the dirty metadata and normal data to storage. The long GC latency will degrade the response times of user requests. In this paper, we propose a GC journaling technique, which journals only the file system changes relevant to the GC process without invoking the high cost checkpointings.

Original language	English
Title of host publication	2015 International Symposium on Consumer Electronics, ISCE 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781467373654
DOIs	https://doi.org/10.1109/ISCE.2015.7177770
State	Published - 4 Aug 2015
Event	IEEE International Symposium on Consumer Electronics, ISCE 2015 - Madrid, Spain Duration: 24 Jun 2015 → 26 Jun 2015

Publication series

Name	Proceedings of the International Symposium on Consumer Electronics, ISCE
Volume	2015-August

Conference

Conference	IEEE International Symposium on Consumer Electronics, ISCE 2015
Country/Territory	Spain
City	Madrid
Period	24/06/15 → 26/06/15

Keywords

Checkpointing
flash storage
garbage collection
log-structured file system

Access to Document

10.1109/ISCE.2015.7177770

Cite this

Gwak, H., Kang, Y., & Shin, D. (2015). Reducing garbage collection overhead of log-structured file systems with GC journaling. In 2015 International Symposium on Consumer Electronics, ISCE 2015 Article 7177770 (Proceedings of the International Symposium on Consumer Electronics, ISCE; Vol. 2015-August). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISCE.2015.7177770

@inproceedings{85f15c43fddd435bb6565bb0dc004681,

title = "Reducing garbage collection overhead of log-structured file systems with GC journaling",

abstract = "The log-structured file system (LFS) writes all modifications to storage sequentially with append-only logging scheme. This characteristic of LFS is very advantageous to flash storages since the flash memory does not permit in-place overwrite. However, LFS has a high garbage collection (GC) overhead. In particular, under the lazy metadata update scheme, each GC process should invoke the high-cost checkpointing which flushes all the dirty metadata and normal data to storage. The long GC latency will degrade the response times of user requests. In this paper, we propose a GC journaling technique, which journals only the file system changes relevant to the GC process without invoking the high cost checkpointings.",

keywords = "Checkpointing, flash storage, garbage collection, log-structured file system",

author = "Hyunho Gwak and Yunji Kang and Dongkun Shin",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; IEEE International Symposium on Consumer Electronics, ISCE 2015 ; Conference date: 24-06-2015 Through 26-06-2015",

year = "2015",

month = aug,

day = "4",

doi = "10.1109/ISCE.2015.7177770",

language = "English",

series = "Proceedings of the International Symposium on Consumer Electronics, ISCE",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2015 International Symposium on Consumer Electronics, ISCE 2015",

}

Gwak, H, Kang, Y & Shin, D 2015, Reducing garbage collection overhead of log-structured file systems with GC journaling. in 2015 International Symposium on Consumer Electronics, ISCE 2015., 7177770, Proceedings of the International Symposium on Consumer Electronics, ISCE, vol. 2015-August, Institute of Electrical and Electronics Engineers Inc., IEEE International Symposium on Consumer Electronics, ISCE 2015, Madrid, Spain, 24/06/15. https://doi.org/10.1109/ISCE.2015.7177770

Reducing garbage collection overhead of log-structured file systems with GC journaling. / Gwak, Hyunho; Kang, Yunji; Shin, Dongkun.
2015 International Symposium on Consumer Electronics, ISCE 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7177770 (Proceedings of the International Symposium on Consumer Electronics, ISCE; Vol. 2015-August).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Reducing garbage collection overhead of log-structured file systems with GC journaling

AU - Gwak, Hyunho

AU - Kang, Yunji

AU - Shin, Dongkun

PY - 2015/8/4

Y1 - 2015/8/4

N2 - The log-structured file system (LFS) writes all modifications to storage sequentially with append-only logging scheme. This characteristic of LFS is very advantageous to flash storages since the flash memory does not permit in-place overwrite. However, LFS has a high garbage collection (GC) overhead. In particular, under the lazy metadata update scheme, each GC process should invoke the high-cost checkpointing which flushes all the dirty metadata and normal data to storage. The long GC latency will degrade the response times of user requests. In this paper, we propose a GC journaling technique, which journals only the file system changes relevant to the GC process without invoking the high cost checkpointings.

AB - The log-structured file system (LFS) writes all modifications to storage sequentially with append-only logging scheme. This characteristic of LFS is very advantageous to flash storages since the flash memory does not permit in-place overwrite. However, LFS has a high garbage collection (GC) overhead. In particular, under the lazy metadata update scheme, each GC process should invoke the high-cost checkpointing which flushes all the dirty metadata and normal data to storage. The long GC latency will degrade the response times of user requests. In this paper, we propose a GC journaling technique, which journals only the file system changes relevant to the GC process without invoking the high cost checkpointings.

KW - Checkpointing

KW - flash storage

KW - garbage collection

KW - log-structured file system

UR - https://www.scopus.com/pages/publications/84953223745

U2 - 10.1109/ISCE.2015.7177770

DO - 10.1109/ISCE.2015.7177770

M3 - Conference contribution

AN - SCOPUS:84953223745

T3 - Proceedings of the International Symposium on Consumer Electronics, ISCE

BT - 2015 International Symposium on Consumer Electronics, ISCE 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - IEEE International Symposium on Consumer Electronics, ISCE 2015

Y2 - 24 June 2015 through 26 June 2015

ER -

Reducing garbage collection overhead of log-structured file systems with GC journaling

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this