請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/84582
標題: | 利用域適應之戴口罩人臉辨識 Masked Face Recognition Using Domain Adaptation |
作者: | Yu-Chieh Huang 黃郁傑 |
指導教授: | 陳宏銘(Homer H. Chen) |
關鍵字: | 人臉辨識,戴口罩人臉影像,域適應,機器學習,深度學習, face recognition,masked face images,domain adaptation,machine learning,deep learning, |
出版年 : | 2022 |
學位: | 碩士 |
摘要: | 由於新冠肺炎(COVID-19)疫情在全球大流行,口罩已成為我們日常生活中的必需品。然而,帶口罩嚴重降低人臉識別系統的性能。由於相機拍攝到的是戴口罩人臉影像,而資料庫中儲存的是沒戴口罩人臉影像,兩者在特徵激活區域以及特徵分佈上存在差異,使得兩者特徵無法正確地匹配。在本論文中,我們提出了一個創新的人臉識別系統來解決此問題。此系統整合了域適應層以及特徵精煉層。特徵精煉層基於自注意力機制的結構,將沒戴口罩人臉影像的特徵激活區域與戴口罩人臉影像的特徵激活區域對齊。域適應層使系統從沒戴口罩人臉域適應到合成以及真實戴口罩人臉域。我們透過人臉驗證和人臉識別任務來測驗系統在真實資料集上的表現。在RMFD_FV和MFR2資料集上,我們的方法能分別提高6.83%和4.2%的人臉驗證準確率。在MFRFI資料集上,人臉識別準確率則提高了15.43%。 Wearing facial masks has become a must in our daily life due to the global COVID-19 pandemic. However, it severely degrades the performance of a face recognition system. The performance degradation is mainly due to the fact that the face images in the gallery are unmasked faces while the probe face images captured by the camera are masked faces, which makes the probe face images different from gallery face images in activated region and distribution domain. In this thesis, we propose a novel face recognition system to address the issue. The system is integrated with a domain adaptation layer and a feature refinement layer. The feature refinement layer is based on the structure of the self-attention mechanism to align activated regions of unmasked faces with those of masked faces. The domain adaptation layer works by adapting the system from the unmasked face domain to the synthetically masked face domain and the real-world masked face domain. The system is tested on real-world data through face verification and face identification. The face verification accuracy is improved by 6.83% for the RMFD_FV dataset and 4.2% for the MFR2 dataset, and the face identification accuracy is improved by 15.43% for the MFRFI dataset. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/84582 |
DOI: | 10.6342/NTU202203492 |
全文授權: | 同意授權(限校園內公開) |
電子全文公開日期: | 2027-09-19 |
顯示於系所單位: | 電信工程學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
U0001-1609202220420600.pdf 目前未授權公開取用 | 2.15 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。