請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/35938
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 張堂賢 | |
dc.contributor.author | Yi-Ru Chen | en |
dc.contributor.author | 陳怡如 | zh_TW |
dc.date.accessioned | 2021-06-13T07:48:29Z | - |
dc.date.available | 2005-07-30 | |
dc.date.copyright | 2005-07-30 | |
dc.date.issued | 2005 | |
dc.date.submitted | 2005-07-26 | |
dc.identifier.citation | [1] Aoki, M. (1999), Imaging and Analysis of Traffic Scene, Proceedings of 1999 International Conference on Image Processing, 24-28 October, Kobe, Japan, vol. 4, pp. 1-5.
[2] Birchfield, S. (1998), Elliptical head tracking using intensity gradients and color histograms, IEEE Conference on Computer Vision and Pattern Recognition, Santa Barbara, California, pp. 232-237. [3] Bitter, R., Smrcha, P., Vysoky, P., Hana, K., Pousek, L., and Schreib, P., (2000), Detecting of Fatigue States of a Car Driver, ISMDA 2000, Processing of Frankfurt, Germany, pp. 260-273. [4] Bitter, R., Smrcha, P., Vysoky, P., Hana, K., Pousek, L., and Schreib, P., (2003), Fatigue Indicators of Drowsy Drivers Based on Analysis of Physiological Signals, Lecture Notes in Computer Science, Vol. 2199/ 2001. pp. 62-63. [5] Cervero, R. (1995), The Transit Metropolis, Insland Press, Washington, D.C. and Covelo, California. [6] Chan, C.C., Lee, V., and Leung, H. (1997), Rader Tracking for Air Surveillance in a Stressful Environment Using a Fazzy-Gain Filter, IEEE Transactions on Fuzzy System, vol. 5, no.1, pp. 80-89. [7] Davis, L.S. (1975), a Survey of Edge Detection Techniques, Computer Graphics and Image Processing, vol. 4, pp. 248-270. Eriksson, M., and Papanikolopoulos, N.P. (2001), Driver Fatigue: a vision- based approach to automatic diagnosis, Transportation Research Part C, vol. 9, pp. 399-413. [8] Fletcher, L., Apostoloff, N., Petersson, L., and Zelinsky A. (2003), Vision in and out of Vehicles. IEEE Computer Society, vol. 18, No. 3, pp. 12-17. [9] Gavrila, D.M., Franke, U., Wohler, C. and Gorzig, S. (2001), Real time vision for intelligent vehicles, IEEE Instrumentation & Measurement Magazine, June, vol. 4, pp. 22-27. [10] Gonzalez, R.C., and Woods, R.E. (1992), Digital Image Processing. Addison-Wesley Publishing Company. [11] Grace, R., Byrne, V.E., Bierman, D.M., Legrand, J., Gricourt, D., Davis, B.K., Staszewski, J.J., and Carnahan, B. (2001), A Drowsy Driver Detection System for Heavy Vehicles, Proceedings of the 17th Digital Avionics Systems Conference, Vol. 2, pp. 136/1-136/8. [12] Han, H., Kawaguchi, T., and Nagata, R. (2002), Eye Detection Based on Grayscale Morphology, Proceedings of IEEE TENCON’02, Region 10 Conference on Computers, Communications, Control and Power Engineering, Vol. 1, 28-31 Oct, pp. 489-502. [13] Jain, A.K. (1989), Fundamentals of Digital Image Processing, Prentice Hall. Ji, Q., Zhu, Z., and Lan, P. (2004), Real Time Non-intrusive Monitoring and Prediction of Driver Fatigue, IEEE Transactions on Vehicular Technology, pp. 1-38. [14] Kumar, R.T., Raja, S.K., Ramakrishnan, A.G. (2002), Eye Detection Using Color cues and Projection Functions. In Proceedings 2002 International Conference on Image Processing ICIP, Vol.3, pp. 337-340, Rochester, New York,USA. [15] Lin, C.H. (2002), Preceding Vehicle Tracking Using Image Processing, M.S. Thesis, Department of Civil Engineering, National Taiwan University. [16] Liu, X., Xu, F. and Fujimura, K. (2002), Real-Time Eye Detection and Tracking for Driver Observation Under Various Light Conditions. IEEE Intelligent Vehicle Symposium, Versailles, France, June 18-20, 2002. [17] Ludtke, H., Wilhelm, B., Adler, M., Schaeffel, F., and Wilhelm, H. (1998), Mathematical procedures in data recording and processing of papillary fatigue waves. Vision Research, Vol. 38, Issue 19, pp. 2889-2896. [18] Serra, J. (1982), Image Analysis and Mathematical Morphology. Academic Press. Perez, A., Cordoba, M.L., Garcia, A., Mendez, R., Munoz, M.L., Pedraza, J.L., and Sanchez, F. (2003), A Precise Eye-Gaze Detection and Tracking System. Proceedings of WSCG POSTERS , 3-7 Feb, Plzen, Czech Republic. [19] Smith, P. (2003), Determining Driver Visual Attention With One Camera, IEEE Transactions on Intelligent Transportation System, Vol. 4, No. 4, pp.205-218 [20] Svensson, U. (2004), Blink behavior based drowsiness detection method- development and validation, Linkoeping University, Sweden, Report No.: LiTH-IMT/BIT20-EX--04/369--. [21] Verwwy, W.B. and Zaidel, D.M. (2000), Predicting Drowsiness Accidents from Personal Attributes, Eye Blinks and Ongoing Driving Behaviour, Personality and Individual Differences, Vol. 28, pp. 123-142. [22] Weiner, D., and Kiryati, N. (2003), Virtual gaze redirection in face images, Proceeding of the 12th International Conference on Image Analysis and Processing (ICIAP’03), 17-19 Sept. pp. 76-81. [23] Weirwille, W.W., Wreggit, S.S., Kirn, C.L., Ellsworth, L.A., and Fairbanks, R.J. (1994), Research on Vehicle-Based Driver Status/Performance Monitoring; Development, Validation, and Refinement of Algorithms for detection of Driver Drowsiness. Vehicle Analysis and Simulation Laboratory, Virginia Polytechnic Institute and State University, VPISU Report No. ISE 94-04, NHTSA Report No. DOT HS 808 247. [24] Zhang, L., and Lenders, P.(2000), Knowledge-Based Eye Detection for Human Face Recognition, Fourth International Conference on knowledge-based Intelligent Engineering System and Allied Technologies, Brighton, UK. pp. 117-120. [25] Zhu, Z., Ji, Q., Fujimura, K., and Lee, K. C. (2002), Combining Kalman Filtering and Mean Shift for Real Time Eye Tracking under Active Illumination, in International Conference on Pattern Recognition, Quebec, Canada. [26] Zhu, Z., and Ji, Q. (2004), Eye and Gaze Tracking for Interactive Graphic Display, Machine Vision and Application, Vol. 15, No. 3, pp. 139-148. [27] Zhu, Z., and Ji, Q. (2005), Robust Real-time Eye Detection and Tracking Under Variable Lighting Conditions and Various Face Orientations, Preceding in the special issue on eye detection and tracking, Computer Vision and Image Understanding, Vol. 38, pp. 124-154. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/35938 | - |
dc.description.abstract | 本研究針對駕駛疲勞建構一套以電腦視覺為基礎的眼部偵測警示系統,利用紅外線攝影機紀錄駕駛人眼睛的運動特性。當解讀出有疲倦駕駛行為時,車內警示系統會適時發出警訊促使駕駛人恢復警覺;如果駕駛人仍無法保持清醒狀況,系統會透過通訊設備自動發送緊急訊息至Telematics服務中心,客服人員在接獲通報後將主動與車端聯繫,藉由與駕駛人攀談的方式以消除其駕駛疲勞。本系統將依序構建「眼部偵測模組」與「疲勞警示模組」。
「眼部偵測模組」中,本研究構建一套監控駕駛人警覺狀況的影像處理程序以逐步確認眼睛位置,包含:臉部偵測、眼睛偵測以及眼睛追蹤。首先,臉部偵測的目的為減少畫面中的搜尋範圍,其演算法在光線充足下是利用橢圓形樣板比對出最似人臉區域;光線不足下改以紅外線輔助光源投射於駕駛頭部並利用動態門檻值將人臉與背景分離。待臉部偵測完畢,初步眼睛偵測是利用累積影像相減法逐一篩選出候選點,再進一步以邊界偵測器過濾出最具眼睛特徵的目標物而決定眼睛位置完成標記。最後利用α-β濾波預測下一次目標物將出現的位置以獲得更佳的偵測結果,此追蹤模式使得模組更為穩健。 在「疲勞警示模組」中,閉眼延時百分率(PERCLOS)與平均眨眼速率(AECS)為判斷駕駛警覺程度的重要參數,本研究利用倒傳遞類神經網路的學習訓練功能獲得適性門檻值以解決因人而異的眼部運動特性。警覺程度與行車速率將共同決定警示程度,利用模糊隸屬函數產生的警示門檻值可避免發出不必要的警訊干擾駕駛人,譬如在車行速度緩慢下,駕駛人的警覺程度可稍有懈怠而不會產生警示。 本研究共測試四個環境,其中三個案例的眼部偵測成功率達97.8%;另一個案例則因駕駛人佩戴眼鏡造成失誤率攀高,眼鏡上的光流會造成誤判,但其成功率也達84.8%。故本系統在大部分的環境下具可行性。 | zh_TW |
dc.description.abstract | This study developed computer vision-based eye detection and warning system. The purpose of this system is to perform detection of driver fatigue. By mounting a small infrared camera on the dashboard, a driver’s eyelid movements are recorded. While this driver is tired and no longer in condition to drive, a warning signal would be issued, and at urgent time, an emergency call would deliver to Telematics Call Center automatically where agents could offer a real-time help to link the driver by voice-activated cellular phone.
Eye Detection Module contains three major parts: face detection, eye detection, and eye tracking. Face detection algorithms are developed to reduce searching areas. These methods are based on both ellipse-template matching in daytime and dynamic threshold selection in nighttime. After determining the face, an accumulative different image method is used to extract eye candidates in primary step. Further, an edge detector is used to find the most possible eye targets to separate other objects such as eyebrows. Finally, to make the module more robust, a α-β filter is used to track eye targets in subsequence frame. This eye detection module is used to calculate the breadth of eye open to determine vigilance levels of a driver. To monitor a driver fatigue, both Percentage of Eye Closure over Time (PERCLOS) and Average Eye Closure Speed (AECS) are calculated. Because eyelid movement characters are distinct from people, a Backpropagation Neural Network is applied to learn and train the adaptive vigilance levels by different drivers. Combing vigilance levels and vehicle speeds, a warning threshold is determined by Fuzzy Membership Functions, which can prevent unnecessary warning signals. For example, although a driver is very tired, the alert wouldn’t work if the car moves slowly. There are total 4 test cases in the experimental results. Only one case failed because this driver wearing glasses which cause optical-flow to reduce eye detection accuracy. But in this failed case, the probability of success is still around 84.8 %. The probabilities of success are all above 97.8 % in the other cases. It shows this system is feasible to most cases. | en |
dc.description.provenance | Made available in DSpace on 2021-06-13T07:48:29Z (GMT). No. of bitstreams: 1 ntu-94-R92521507-1.pdf: 2824247 bytes, checksum: ee276bec54ada0612335ac592bce743c (MD5) Previous issue date: 2005 | en |
dc.description.tableofcontents | Chapter One Introduction....1
1.1 Background and Motivation....1 1.2 Objective....5 1.3 Literature Review....7 1.4 Thesis Organization....11 Chapter Two Fundamental Image Processing Techniques....12 2.1 Image Acquisition Device....12 2.1.1 Assistant Light Source for Image Acquisitions....12 2.1.2 A CCD Camera for Image Acquisition....13 2.2 Image Processing Techniques....15 2.2.1 Thresholding for Binarization....15 2.2.2 Edge Detection for Finding Profiles....16 2.2.3 Erosion and Dilation for Deleting and Forming Components....18 2.2.4 Projection for Specific Objects....19 2.2.5 Connected Component Labeling for Region Segmentations....20 2.2.6 Histogram for Computing Brightness Index....20 Chapter Three Eye Detection and Tracking Module....22 3.1 System Architecture....22 3.2 Face Detection....24 3.2.1 Daytime Condition for Face Detection....25 3.2.2 Nighttime Condition for Face Detection....27 3.2.3 Discussions of Face Detection....30 3.3 Eye Detection....32 3.3.1 Primary Step for Eye Detection....32 3.3.2 Advanced Step for Eye Detection....37 3.3.3 Discussions of Eye Detection....39 3.4 Eye Tracking....41 3.4.1 Alpha-Beta Filters for Location Prediction....42 3.4.2 Prediction Error for Searching Window Size....46 Chapter 4 Driver Fatigue Warning Module....51 4.1 Eyelid Movement Parameters....51 4.1.1 Definitions of PERCLOS and AECS....51 4.1.2 Computation of PERCLOS....54 4.1.3 Computation of AECS....55 4.2 Backpropagation Neural Networks for Vigilance Levels....56 4.2.1 Artificial Neuron Networks Application....57 4.2.2 Design and Implementation....63 4.3 Fuzzy Membership Functions for Warning Threshold....66 4.3.1 Input One: Vehicle Velocity (V)....68 4.3.2 Input Two: Vigilance Level (Lv)....69 4.3.3 Output: Warning Level (Lw)....69 4.3.4 Fuzzy Rules....70 4.3.5 Decision Surface for Determining Warning Level....71 4.4 Telematics Call Center....74 4.4.1 Categories of Emergency Calls....76 4.4.2 Vehicle Procedure....76 4.4.3 Telematics Call Center Procedure....79 Chapter Five Experimental Results....81 5.1 Experiments for Eye Detection and Tracking Module....81 5.2 Experiments for Warning Module....84 Chapter Six Conclusions....87 6.1 Summary....87 6.2 Future Work....89 Reference....91 | |
dc.language.iso | en | |
dc.title | 電腦視覺眼部偵測為基礎之駕駛疲勞警示系統 | zh_TW |
dc.title | Computer Vision-based Eye Detection and Warning System for Driver Fatigue | en |
dc.type | Thesis | |
dc.date.schoolyear | 93-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 蔣德智,高秀枝,劉主域 | |
dc.subject.keyword | 駕駛疲勞,眼睛偵測,倒傳遞類神經網路,模糊隸屬函數,Telematics客服中心, | zh_TW |
dc.subject.keyword | Driver Fatigue,Eye Detection,Backpropagation Neural Network,Fuzzy Membership Function,Telematics Call Center, | en |
dc.relation.page | 94 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2005-07-26 | |
dc.contributor.author-college | 工學院 | zh_TW |
dc.contributor.author-dept | 土木工程學研究所 | zh_TW |
顯示於系所單位: | 土木工程學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-94-1.pdf 目前未授權公開取用 | 2.76 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。