Please use this identifier to cite or link to this item:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/84582
Title: | 利用域適應之戴口罩人臉辨識 Masked Face Recognition Using Domain Adaptation |
Authors: | Yu-Chieh Huang 黃郁傑 |
Advisor: | 陳宏銘(Homer H. Chen) |
Keyword: | 人臉辨識,戴口罩人臉影像,域適應,機器學習,深度學習, face recognition,masked face images,domain adaptation,machine learning,deep learning, |
Publication Year : | 2022 |
Degree: | 碩士 |
Abstract: | 由於新冠肺炎(COVID-19)疫情在全球大流行,口罩已成為我們日常生活中的必需品。然而,帶口罩嚴重降低人臉識別系統的性能。由於相機拍攝到的是戴口罩人臉影像,而資料庫中儲存的是沒戴口罩人臉影像,兩者在特徵激活區域以及特徵分佈上存在差異,使得兩者特徵無法正確地匹配。在本論文中,我們提出了一個創新的人臉識別系統來解決此問題。此系統整合了域適應層以及特徵精煉層。特徵精煉層基於自注意力機制的結構,將沒戴口罩人臉影像的特徵激活區域與戴口罩人臉影像的特徵激活區域對齊。域適應層使系統從沒戴口罩人臉域適應到合成以及真實戴口罩人臉域。我們透過人臉驗證和人臉識別任務來測驗系統在真實資料集上的表現。在RMFD_FV和MFR2資料集上,我們的方法能分別提高6.83%和4.2%的人臉驗證準確率。在MFRFI資料集上,人臉識別準確率則提高了15.43%。 Wearing facial masks has become a must in our daily life due to the global COVID-19 pandemic. However, it severely degrades the performance of a face recognition system. The performance degradation is mainly due to the fact that the face images in the gallery are unmasked faces while the probe face images captured by the camera are masked faces, which makes the probe face images different from gallery face images in activated region and distribution domain. In this thesis, we propose a novel face recognition system to address the issue. The system is integrated with a domain adaptation layer and a feature refinement layer. The feature refinement layer is based on the structure of the self-attention mechanism to align activated regions of unmasked faces with those of masked faces. The domain adaptation layer works by adapting the system from the unmasked face domain to the synthetically masked face domain and the real-world masked face domain. The system is tested on real-world data through face verification and face identification. The face verification accuracy is improved by 6.83% for the RMFD_FV dataset and 4.2% for the MFR2 dataset, and the face identification accuracy is improved by 15.43% for the MFRFI dataset. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/84582 |
DOI: | 10.6342/NTU202203492 |
Fulltext Rights: | 同意授權(限校園內公開) |
metadata.dc.date.embargo-lift: | 2027-09-19 |
Appears in Collections: | 電信工程學研究所 |
Files in This Item:
File | Size | Format | |
---|---|---|---|
U0001-1609202220420600.pdf Restricted Access | 2.15 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.