TY - JOUR
T1 - Efficient and Robust Object Detection Against Multi-Type Corruption Using Complete Edge Based on Lightweight Parameter Isolation
AU - Kim, Youngjun
AU - Shin, Jitae
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2024/2/1
Y1 - 2024/2/1
N2 - The objective of robust object detection against multi-type corruption (MTC) is to improve detection performance in various domains, including common risks in real-world applications, such as noise, blur, adverse weather, digital errors, and more. In driving scenarios, MTC can occur due to harsh conditions like tunnels, extended driving periods, high temperatures, object movements, and even desert driving. However, addressing MTC poses a significant challenge as it can lead to catastrophic forgetting (CF) issues due to domain shifts. To enhance robustness without encountering CF, we propose the unified stem block for corruption (USB-C). This approach overcomes CF by utilizing complete edge (CE), which not only represents the external edges of objects but also captures internal information. In addition, we introduce the DC-Converter, facilitating efficient CE extraction under MTC conditions using lightweight parameter isolation. Our method not only enhances robustness without CF-induced performance degradation but also achieves over 20 FPS on a single consumer-grade GPU with minimal additional memory usage. The performances are demonstrated through experiments on COCO-C and BDD100K benchmarks. Moreover, our method demonstrates a model-agnostic property as it can be applied to two representative detectors, RetinaNet and Faster R-CNN.
AB - The objective of robust object detection against multi-type corruption (MTC) is to improve detection performance in various domains, including common risks in real-world applications, such as noise, blur, adverse weather, digital errors, and more. In driving scenarios, MTC can occur due to harsh conditions like tunnels, extended driving periods, high temperatures, object movements, and even desert driving. However, addressing MTC poses a significant challenge as it can lead to catastrophic forgetting (CF) issues due to domain shifts. To enhance robustness without encountering CF, we propose the unified stem block for corruption (USB-C). This approach overcomes CF by utilizing complete edge (CE), which not only represents the external edges of objects but also captures internal information. In addition, we introduce the DC-Converter, facilitating efficient CE extraction under MTC conditions using lightweight parameter isolation. Our method not only enhances robustness without CF-induced performance degradation but also achieves over 20 FPS on a single consumer-grade GPU with minimal additional memory usage. The performances are demonstrated through experiments on COCO-C and BDD100K benchmarks. Moreover, our method demonstrates a model-agnostic property as it can be applied to two representative detectors, RetinaNet and Faster R-CNN.
KW - autonomous-driving
KW - catastrophic forgetting
KW - multi-type corruption
KW - parameter-isolation
KW - Robust object detection
UR - https://www.scopus.com/pages/publications/85182387905
U2 - 10.1109/TIV.2024.3351271
DO - 10.1109/TIV.2024.3351271
M3 - Article
AN - SCOPUS:85182387905
SN - 2379-8858
VL - 9
SP - 3181
EP - 3194
JO - IEEE Transactions on Intelligent Vehicles
JF - IEEE Transactions on Intelligent Vehicles
IS - 2
ER -