請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/61483完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 陳宏銘(Homer H. Chen) | |
| dc.contributor.author | Yu-Hsuan Huang | en |
| dc.contributor.author | 黃于瑄 | zh_TW |
| dc.date.accessioned | 2021-06-16T13:03:59Z | - |
| dc.date.available | 2020-07-20 | |
| dc.date.copyright | 2020-07-20 | |
| dc.date.issued | 2020 | |
| dc.date.submitted | 2020-06-29 | |
| dc.identifier.citation | [1] A. W. Senior and R. M. Bolle, “Face recognition and its applications,” Chapter 4, Biometric Solutions, Springer US, 2002, pp. 83–97. [2] B. Kamgar-Parsi, W. Lawson, and B. Kamgar-Parsi, “Toward development of a face recognition system for watchlist surveillance,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 1925–1937, 2011. [3] M. Hassaballah and S. Aly, “Face recognition: Challenges, achievements, and future directions,” IET Computer Vision, vol. 9, no. 4, pp. 614–626, 2014. [4] J. Galbally, S. Marcel, and J. Fierrez, “Image quality assessment for fake biometric detection: Application to iris, fingerprint, and face recognition,” IEEE Transactions on Image Processing, vol. 23, no. 2, pp. 710–724, 2014. [5] P. Tome, J. Fierrez, R. Vera-Rodriguez, and M. Nixon, “Soft biometrics and their application in person recognition at a distance,” IEEE Transactions on Information Forensics and Security, vol. 9, no. 3, pp. 464–475, 2014. [6] R. Raghavendra, K. B. Raja, and C. Busch, “Presentation attack detection for face recognition using light field camera,” IEEE Transactions on Image Processing, vol. 24, no. 3, pp. 1060–1075, 2015. [7] Y. Taigman, M. Yang, M. A. Ranzato, and L. Wolf, “Deepface: Closing the gap to human-level performance in face verification,” in Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1701−1708, 2014. [8] Y. Sun, Y. Chen, X. Wang, and X. Tang, “Deep learning face representation by joint identification-verification,” in Proc. Advances in Neural Information Processing Systems, pp. 1988–1996, 2014. [9] M. Wang and W. Deng, “Deep face recognition: A survey,” arXiv: 180406655, 2019. [10] F. Schroff, D. Kalenichenko, and J. Philbin, “Facenet: A unified embedding for face recognition and clustering,” in Proc. IEEE Conference Computer Vision and Pattern Recognition, pp. 815–823, 2015. [11] W. Liu, Y. Wen, Z. Yu, M. Li, B. Raj, and L. Song, “SphereFace: Deep hypersphere embedding for face recognition,” in Proc. IEEE Conference Computer Vision and Pattern Recognition, pp. 6738–6746, 2017. [12] H. Wang et al., “CosFace: Large margin cosine loss for deep face recognition,” in Proc. IEEE Conference Computer Vision and Pattern Recognition, pp. 5265–5274, 2018. [13] J. Deng, J. Guo, N. Xue, and S. Zafeiriou, “ArcFace: Additive angular margin loss for deep face recognition,” in Proc. IEEE Conference Computer Vision and Pattern Recognition, pp. 4685–4694, 2019. [14] E. Learned-Miller, G. B. Huang, A. RoyChowdhury, H. Li, and G. Hua, “Labeled faces in the wild: A survey,” Advances in Face Detection and Facial Image Analysis, Springer, pp. 189–248, 2016. [15] Y. Moses, Y. Adini, and S. Ullman, “Face recognition: The problem of compensating for changes in illumination direction,” in Proc. European Conference Computer Vision, pp. 286–296, 1994. [16] X. Xie, W.-S. Zheng, J. Lai, and P. C. Yuen, “Face illumination normalization on large and small scale features,” in Proc. IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8, 2008. [17] T. Zhang, Y.-Y. Tang, B. Fang, Z. Shang, and X. Liu, “Face recognition under varying illumination using gradientfaces,” IEEE Transactions on Image Processing, vol. 18, no. 11, pp. 2599–2606, 2009. [18] X. Tan and B. Triggs, “Enhanced local texture feature sets for face recognition under difficult lighting conditions,” IEEE Transactions on Image Processing, vol. 19, no. 6, pp. 1635–1650, Jun. 2010. [19] X. Xie, W.-S. Zheng, J. Lai, P. C. Yuen, and C. Y. Suen, “Normalization of face illumination based on large and small scale features,” IEEE Transactions on Image Processing, vol. 20, no. 7, pp. 1807–1821, 2011. [20] P. Vageeswaran, K. Mitra, and R. Chellappa, “Blur and illumination robust face recognition via set-theoretic characterization,” IEEE Transactions on Image Processing, vol. 22, no. 4, pp. 1362–1372, 2013. [21] Z.-R. Lai, D.-Q. Dai, C.-X. Ren, and K.-K. Huang, “Multiscale logarithm difference edgemaps for face recognition against varying lighting conditions,” IEEE Transactions on Image Processing, vol. 24, no. 6, pp. 1735–1747, 2015. [22] C. Zou, K. Kou, and Y. Wang, “Quaternion collaborative and sparse representation with application to color face recognition,” IEEE Transactions on Image Processing, vol. 25, no. 7, pp. 3287–3302, 2016. [23] V. Blanz, and T. Vetter, “A morphable model for the synthesis of 3D faces,” in Proc. SIGGRAPH, pp. 187–194, 1999. [24] V. Blanz, S. Romdhani, and T. Vetter, “Face identification across different poses and illuminations with a 3D morphable model,” in Proc. Fifth International Conference Automatic Face and Gesture Recognition, pp. 202–207, 2002. [25] V. Blanz and T. Vetter, “Face recognition based on fitting a 3D morphable model,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063–1074, 2003. [26] Q. Li, J. Ye, and C. Kambhamettu, “Linear projection methods in face recognition under unconstrained illumination: A comparative study,” in Proc. IEEE Conference Computer Vision and Pattern Recognition, pp. 2474–2481, 2004. [27] S. Romdhani, J. Ho, T. Vetter, and D. J. Kriegman, “Face recognition using 3-D models: Pose and illumination,” Proc. IEEE, vol. 94, no. 11, pp. 1977–1999, 2006. [28] L. Seong-Whan, S. W. Lee, and M. Song-Hyang, “Face recognition under arbitrary illumination using illuminated exemplars,” Pattern Recognition, vol. 40, no. 5, pp. 1605–1620, 2007. [29] K. H. An and M. Chung, “3D head tracking and pose-robust 2D texture map-based face recognition using a simple ellipsoid model,” in Proc. IEEE International Conference on Intelligent Robots and Systems., pp. 307–312, 2008. [30] P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter, “A 3D face model for pose and illumination invariant face recognition,” in Proc. IEEE Sixth International Conference on Advanced Video and Signal Based Surveillance, pp. 296–301, 2009. [31] S. Biswas, G. Aggarwal, and R. Chellappa, “Robust estimation of albedo for illumination-invariant matching and shape recovery,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 5, pp. 884–899, 2009. [32] A. Punnappurath, A. N. Rajagopalan, S. Taheri, R. Chellappa, and G Seetharaman, “Face recognition across non-uniform motion blur, illumination, and pose,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 2067–2082, 2015. [33] E. H. Land and J. J. McCann, “Lightness and retinex theory,” Journal of the Optical Society of America, vol. 61, no. 1, pp. 1−11, 1971. [34] M. Abdullah-Al-Wadud, M. H. Kabir, M. A. Akber Dewan and O. Chae, “A dynamic histogram equalization for image contrast enhancement,” IEEE Transactions on Consumer Electronics, vol. 53, no. 2, pp. 593−600, 2007. [35] A. M. Reza, “Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement,” Journal of VLSI Signal Processing Systems for Signal, Image and Video Technology, vol. 38, no. 1, pp. 35−44, 2004. [36] X. Guan, et. al, “An image enhancement method based on gamma correction,” in Proc. IEEE Second International Symposium on Computational Intelligence and Design, pp. 60−63, 2009. [37] P. Haeberli and D. Voorhies, “Image processing by linear interpolation and extrapolation,” IRIS Universe Magazine, vol. 28, pp. 8−9, 1994. [38] Z. Ying, G. Li, Y. Ren, R. Wang, and W. Wang, “A new image contrast enhancement algorithm using exposure fusion framework,” in Proc. International Conference on Computer Analysis of Images and Patterns, Springer, pp. 36−46, 2017. [39] W. Wang, C. Wei, W., and Yang, J. Liu, “GLADNet: Low-light enhancement network with global awareness,” in Proc. IEEE International Conference on Automatic Face Gesture Recognition, pp. 751−755, 2018. [40] C. Szegedy et al., “Going deeper with convolutions,” in Proc. IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–9, 2015. [41] M. Afifi and A. Abdelhamed, “Afif4: Deep gender classification based on adaboost-based fusion of isolated facial features and foggy faces,” arXiv:1706.04277, 2017. [42] K. Zhang, Z. Zhang, Z. Li, and Y. Qiao, “Joint face detection and alignment using multitask cascaded convolutional networks,” IEEE Signal Processing Letters, vol. 23, no. 10, pp. 1499–1503, 2016. [43] A. Mosinska, P. Marquez-Neila, M. Kozinski, and P. Fua, “Beyond the pixel-wise loss for topology-aware delineation,” in Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 3136–3145, 2018. [44] P. Fischer et al., “FlowNet: Learning optical flow with convolutional networks,” in Proc. IEEE International Conference on Computer Vision, pp. 2758–2766, 2015. [45] V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” in Proc. International Conference on Machine Learning, pp. 807–814, 2010. [46] S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” arXiv:150203167, 2015. [47] D. Yi, Z. Lei, S. Liao, and S. Z. Li, “Learning face representation from scratch,” arXiv:1411.7923, 2014. [48] D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv:14126980, 2017. [49] B. Amos, B. Ludwiczuk, and M. Satyanarayanan, “Openface: A general purpose face recognition library with mobile applications,” CMU-CS-16-118, CMU School of Computer Science, Technical Report, 2016. [50] X. Guo, Y. Li, and H. Ling, “LIME: Low-light image enhancement via illumination map estimation,” IEEE Transactions on Image Processing, vol. 26, no. 2, pp. 982- 993, 2017. [51] A. Ignatov, N. Kobyshev, R. Timofte, K. Vanhoey, and L. V. Gool, “DSLR-quality photos on mobile devices with deep convolutional networks,” in Proc. IEEE International Conference on Computer Vision, pp. 3297–3305, 2017. [52] F. Lv, F. Lu, J. Wu, and C. Lim, “Mbllen: Low-light image/video enhancement using CNNs,” in British Machine Vision Conference, 2018. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/61483 | - |
| dc.description.abstract | 當套用先進的深度人臉辨識模型於低光源下所拍攝到的影像時，會產生嚴重的人臉辨識準確率下降；主要是由於低光源下所拍攝的人臉影像特徵無法與正常光源下所拍攝到的人臉影像特徵被正確地匹配。在本研究中，我們首先評估一種較為直觀的方法，該方法在執行人臉辨識前會先增強人臉影像的對比度及亮度。然後，基於實驗結果，我們提出了一個新穎的深度人臉辨識架構來解決此問題.此架構由一個特徵恢復網路(feature restoration network)、特徵提取網路(feature extraction network)、特徵向量優化模組(embedding refinement module)，以及特徵向量匹配模組(embedding matching module)所組成。特徵恢復網路採用基於卷積神經網路的兩分支結構，從原始影像和亮度增強影像生成特徵恢復影像(feature-restored image)。 特徵提取網路將特徵恢復圖像以高維空間中的特徵向量來表示。該特徵向量由特 徵向量優化模組進行進一步優化，並由特徵向量匹配模組用於人臉驗證(verification)和識別(identification)任務中。我們提出的架構在 SoF 資料集上能將人臉驗證準確率提高 3.1%~9.1%。而在人臉識別任務中，可將 rank-1 的識別準確度提高 3.7%。 | zh_TW |
| dc.description.abstract | The performance of many state-of-the-art deep face recognition models deteriorates significantly for images captured under low illumination, mainly because the features of dim probe face images cannot match well with those of normal-illumination gallery images. In this thesis, we first evaluate an intuitive approach that enhances the illumination of face images before performing face recognition. Then, based on the results, we propose a novel deep face recognition framework to address this issue. The framework consists of a feature restoration network, a feature extraction network, an embedding refinement module, and an embedding matching module. The feature restoration network adopts a two-branch structure based on the convolutional neural network to generate a feature-restored image from the raw image and the illumination-enhanced image. The feature extraction network encodes the feature-restored image into an embedding, which is then made more discriminative by the embedding refinement module and used by the embedding matching module for face verification and identification. The overall verification accuracy is improved from 3.1% to 9.1% when tested on the Specs on Faces (SoF) dataset. For face identification, the rank-1 identification accuracy is improved by 3.7%. | en |
| dc.description.provenance | Made available in DSpace on 2021-06-16T13:03:59Z (GMT). No. of bitstreams: 1 U0001-2606202012144000.pdf: 5105849 bytes, checksum: a7786fcabc1f3686181738dc30f68a58 (MD5) Previous issue date: 2020 | en |
| dc.description.tableofcontents | 口試委員會審定書 # 誌謝 i 中文摘要 ii ABSTRACT iii CONTENTS iv LIST OF FIGURES vi LIST OF TABLES ix Chapter 1 Introduction 1 Chapter 2 Related Work 4 2.1 Deep Face Recognition 4 2.2 Illumination Preprocessing 5 Chapter 3 Evaluation of Illumination Preprocessing for Deep Recognition 6 3.1 Performance Drop Due to Low Illumination 6 3.2 Test 10 3.3 Results 11 Chapter 4 Deep Face Framework 18 4.1 Feature Restoration Network 19 4.2 Embedding Refinement 20 Chapter 5 Network Design and Loss Functions 23 5.1 Feature Restoration Network Design 23 5.2 Loss Functions 24 5.2.1 Pixel-wise Loss 24 5.2.2 Feature Loss 25 5.2.3 ArcFace Loss 26 Chapter 6 Experiments 28 6.1 Modification of FlowNetS 28 6.2 Retraining of ArcFace 30 6.3 Datasets 30 6.4 Experimental Setup 31 6.5 Metrics 32 6.6 Results of Experiment 1 32 6.7 Results of Experiment 2 38 Chapter 7 Discussion and Conclusion 44 7.1 Performance of OpenFace 44 7.2 Performance of Feature Restoration Network Due to Normal Illumination 45 7.3 Adjusted Deep Face Recognition Framework 46 7.4 Conclusion 48 REFERENCE 49 | |
| dc.language.iso | en | |
| dc.title | 用於暗淡影像之深度人臉辨識 | zh_TW |
| dc.title | Deep Face Recognition for Dim Images | en |
| dc.type | Thesis | |
| dc.date.schoolyear | 108-2 | |
| dc.description.degree | 碩士 | |
| dc.contributor.oralexamcommittee | 莊永裕(Yung-Yu Chuang),莊仁輝(Jen-Hui Chuang),鄭文皇(Wen-Huang Cheng),劉庭祿(Tyng-Luh Liu) | |
| dc.subject.keyword | 人臉辨識; 低亮度影像; rank1-識別準確度; 兩分支網路; 卷積神經網路 | zh_TW |
| dc.subject.keyword | Face recognition; dim image; rank-1 identification accuracy; two-branch network; convolutional neural network | en |
| dc.relation.page | 54 | |
| dc.identifier.doi | 10.6342/NTU202001156 | |
| dc.rights.note | 有償授權 | |
| dc.date.accepted | 2020-06-30 | |
| dc.contributor.author-college | 電機資訊學院 | zh_TW |
| dc.contributor.author-dept | 電信工程學研究所 | zh_TW |
| 顯示於系所單位： | 電信工程學研究所 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| U0001-2606202012144000.pdf 未授權公開取用 | 4.99 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。