TY - GEN
T1 - Implementing 360 video tiled streaming system
AU - Son, Jangwoo
AU - Jang, Dongmin
AU - Ryu, Eun Seok
N1 - Publisher Copyright:
© 2018 Copyright held by the owner/author(s).
PY - 2018/6/12
Y1 - 2018/6/12
N2 - The computing power and bandwidth of the current VR are limited when compared to the high-quality VR. To overcome these limits, this study proposes a new viewport dependent streaming method that transmits 360-degree videos using the high efficiency video coding (HEVC) and the scalability extension of HEVC (SHVC). The proposed SHVC and HEVC encoders generate the bitstream that can transmit tiles independently. Therefore, the bitstream generated by the proposed encoder can be extracted in units of tiles. In accordance with what is discussed in the standard, the proposed extractor extracts the bitstream of the tiles corresponding to the viewport. SHVC video bitstream extracted by the proposed methods consist of (i) an SHVC base layer (BL) which represents the entire 360-degree area and (ii) an SHVC enhancement layer (EL) for selective streaming with viewport (region of interest (ROI)) tiles. When the proposed HEVC encoder is used, low and high resolution sequences are separately encoded as the BL and EL of SHVC. By streaming the BL(low resolution) and selective EL(high resolution) tiles with ROI instead of streaming whole high quality 360-degree video, the proposed method can reduce the network bandwidth as well as the computational complexity on the decoder side. Experimental results show more than 47% bandwidth reduction.
AB - The computing power and bandwidth of the current VR are limited when compared to the high-quality VR. To overcome these limits, this study proposes a new viewport dependent streaming method that transmits 360-degree videos using the high efficiency video coding (HEVC) and the scalability extension of HEVC (SHVC). The proposed SHVC and HEVC encoders generate the bitstream that can transmit tiles independently. Therefore, the bitstream generated by the proposed encoder can be extracted in units of tiles. In accordance with what is discussed in the standard, the proposed extractor extracts the bitstream of the tiles corresponding to the viewport. SHVC video bitstream extracted by the proposed methods consist of (i) an SHVC base layer (BL) which represents the entire 360-degree area and (ii) an SHVC enhancement layer (EL) for selective streaming with viewport (region of interest (ROI)) tiles. When the proposed HEVC encoder is used, low and high resolution sequences are separately encoded as the BL and EL of SHVC. By streaming the BL(low resolution) and selective EL(high resolution) tiles with ROI instead of streaming whole high quality 360-degree video, the proposed method can reduce the network bandwidth as well as the computational complexity on the decoder side. Experimental results show more than 47% bandwidth reduction.
KW - Extraction information set (EIS) SEI
KW - HEVC and SHVC tile
KW - Motionconstrained tile set (MCTS)
KW - Viewport
KW - Virtual reality
UR - https://www.scopus.com/pages/publications/85050651518
U2 - 10.1145/3204949.3208119
DO - 10.1145/3204949.3208119
M3 - Conference contribution
AN - SCOPUS:85050651518
T3 - Proceedings of the 9th ACM Multimedia Systems Conference, MMSys 2018
SP - 521
EP - 524
BT - Proceedings of the 9th ACM Multimedia Systems Conference, MMSys 2018
PB - Association for Computing Machinery, Inc
T2 - 9th ACM Multimedia Systems Conference, MMSys 2018
Y2 - 12 June 2018 through 15 June 2018
ER -