請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/3822
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 洪一平 | |
dc.contributor.author | Chao-Ling Chen | en |
dc.contributor.author | 陳昭伶 | zh_TW |
dc.date.accessioned | 2021-05-13T08:37:10Z | - |
dc.date.available | 2016-12-01 | |
dc.date.available | 2021-05-13T08:37:10Z | - |
dc.date.copyright | 2016-08-24 | |
dc.date.issued | 2016 | |
dc.date.submitted | 2016-08-02 | |
dc.identifier.citation | [1] I. Szollosi, T. Roebuck, B. Thompson and M. T. Naughton, “Lateral sleeping position reduces severity of central sleep apnea / cheyne-stokes respiration,” Sleep: Journal of Sleep Research & Sleep Medicine, 29(8), 2006.
[2] N. A. Eiseman, M. B. Westover, J. M. Ellenbogen and M. T. Bianchi, “The impact of body posture and sleep stages on sleep apnea severity in adults,” Journal of Clinical Sleep Medicine, 8(6), 2012, pp. 655-666. [3] R. D. Cartwright, “Effect of sleep position on sleep apnea severity,” Sleep: Journal of Sleep Research & Sleep Medicine, 7(2), 1984, pp. 110-114. [4] “National Sleep Foundation: snoring and sleep,” https://sleepfoundation.org/sleep-disorders-problems/other-sleep-disorders/snoring/. [5] R. S. T. Leung, M. E. Bowman, J. D. Parker, G. E. Newton and T. D. Bradley, “Avoidance of the left lateral decubitus position during sleep in patients with heart failure: relationship to cardiac size and function,” Journal of the American College of Cardiology, 4(2), 2003, pp. 227-230. [6] P.M. Nicassio, D.R. Mendlowitz, J.J. Fussell and L. Petras, “The phenomenology of the pre-sleep state: the development of the pre-sleep arousal scale,” Journal of Behaviour Research and Therapy 23(3), 1985, pp. 263-271. [7] M.T. Smith, J.A. Haythornthwaite, “How do sleep disturbance and chronic pain inter-relate? Insights from the longitudinal and cognitive-behavioral clinical trials literature,” Journal of Sleep Medicine Review, 8(2), 2004, pp. 119-132. [8] L. C. L. Chen, K. W. Chen and Y. P. Hung, “A sleep monitoring system based on audio, video and depth Information for detecting sleep events,” in Proc. of IEEE International Conference on Multimedia and Expo., 2014. [9] “National Sleep Foundation: Depression and sleep,” https://sleepfoundation.org/sleep-disorders-problems/depression-and-sleep/. [10] E. Bixler, “Sleep and society: an epidemiological perspective,” Journal of Sleep Medicine, 10, 2009, pp. 1-4. [11] K. Asahina, “Paradoxical phase and reverse paradoxical phase in human sleep,” Journal of Physiological Society of Japan, 24, 1962, pp. 443-450. [12] A. Sano and R.W. Picard, “Toward a taxonomy of autonomic sleep patterns with electrodermal activity,” in Proc. of IEEE Engineering in Medicine and Biology Society, 2011. [13] R. J. Cole, D. F. Kripke, W. Gruen, D. J. Mullaney and J. C. Gillin, “Automatic sleep/wake identification from wrist actigraphy,” Sleep: Journal of Sleep Research & Sleep Medicine, 15, 1992, pp. 461-469. [14] F. Wang, M. Tanaka and S. Chonan, “Development of a PVDF piezopolymer sensor for unconstrained in-sleep cardiorespiratory monitoring”, Journal of Intelligent Material System and Structure, 14, 2003, pp. 185-200. [15] K. Nakajima, K. Matsumoto and T. Tamura, “Development of real-time image sequence analysis for evaluating posture change and respiratory rate of a subject in bed, Journal of Physiological Measurement, 22, 2001, pp. N21-N28. [16] J. Lee, M. Hong and S. Ryu, “Sleep monitoring system using Kinect sensor,” International Journal of Distributed Sensor Networks, 875371, 2015. [17] J. Du, C.E. Postma, H.C. Van Vugt and E. Zwartkruis, “Understanding the user needs for sleep enhancement,” Philips Internal Report, 2008. [18] K. Z. Siejko and K. R. Maile, “Method for correction of posture dependence on heart sounds,” US Patent 7662104 B2, 2010. [19] H. Miwa, S. Sasahara and T. Matsui, “Roll-over detection and sleep quality measurement using a wearable Sensor,” in Proc. of IEEE Engineering in Medicine and Biology Society, 2007, pp. 1507-1510. [20] C. C. Hsia, K. J. Liou, A. P. Aung, V. Foo, W. Huang and J. Biswas, “Analysis and comparison of sleeping posture classification methods using pressure sensitive bed system,” in Proc. of IEEE Engineering in Medicine and Biology Society, 2009. [21] J. Kortelainen and J. Virkkala, “PCA model for recording respiration and posture with multichannel BCG sensor in bed mattress,” in Proc. of International Conference on Wearable, Micro & Nano Technologies for Personalized Health, 2007. [22] M. Papakostas, J. Staud, F. Makedon and V. Metsis, “Monitoring breathing activity and sleep patterns using multimodal non-invasive technologies,” in Proc. of ACM International Conference on Pervasive Technologies Related to Assistive Environments, 2015. [23] Y. Booranrom, B.Watanapa and P. Mongkolnam, “Smart bedroom for elderly using Kinect,” in Proc. of Computer Science and Engineering Conference, 2014, pp. 427-432. [24] M. C. Yu, H. Wu, J. L. Liou, M. S. Lee and Y. P. Hung, “Breath and position monitoring during sleeping with a depth camera,” in Proc. of International Conference on Health Informatics, 2012. [25] A. Taylor, H. Wright and L.C. Lack, “Sleeping-in on the weekend delays circadian phase and increases sleepiness the following week,” Journal of Sleep and Biological Rhythms, 6(3), 2008, pp. 172-179. [26] D.F. Dinges and N.B. Kribbs, “Performing while sleepy: effects of experimentally induced sleepiness,” In: T.H. Monk (ed.), Sleep, Sleepiness and Performance, Wiley, 1991, pp. 97-128. [27] M. R. Opp, “Sleeping to fuel the immune system: mammalian sleep and resistance to parasites,” Journal of BMC Evolutionary Biology, 9(1), 2009. [28] E. Urponen, I. Vuori, J. Hasan and M. Partinen, “Self-evaluations of factors promoting and disturbing sleep: an epidemiological survey in Finland,” Journal of Social Science & Medicine, 26, 1988, pp. 443-450. [29] S. Venn, “It’s okay for man to snore: the influence of gender on sleep disruption in couples,” Journal of Social Responsibility, 12(5), 2007. [30] B. H. Jacobson, A. Boolani and D. B. Smith, “Changes in back pain, sleep quality, and perceived stress after introduction of new bedding systems,” Journal of Chiropractic Medicine, 8(1), 2009, pp. 1-8. [31] C. Stauffer and W. Grimson, “Adaptive background mixture models for real-time tracking,” in Proc. of Computer Vision and Pattern Recognition, 1999, pp. 246-252. [32] W. W. Tryon, “Activity measurement in psychology and medicine,” New York: Plenum Press, 1991. [33] M. J. Chambers, “Actigraphy and insomnia: a closer look; part 1,” Sleep: Journal of Sleep Research & Sleep Medicine, 17, 1994, pp. 405-408. [34] J. B. Webster, D. F. Kripke, S. Messin, and et al., “An activity-based sleep monitor system for ambulatory use,” Sleep: Journal of Sleep Research & Sleep Medicine, 5(4), 1982, pp. 389-399. [35] A. Sadeh, K. M. Sharkey and M. A. Carskadon, “Activity-based sleep/wake identification: an empirical test of methodological issues,” Sleep: Journal of Sleep Research & Sleep Medicine, 3, 1994, pp. 201-207. [36] Y. W. Jan, C. W. Chen, C. M. Yang and S. C. Lin, “Validation of the Chinese version of the pre-sleep arousal scale (PSAS),” Journal of Archives of Clinical Psychology, 4(1), 2009, pp. 51-58. [37] D. J. Buysse, C. F. Reynolds, T. H. Monk, C. C. Hoch, and et al., “Quantification of subjective sleep quality in healthy elderly men and women using the pittsburgh sleep quality index (PSQI),” Sleep: Journal of Sleep Research & Sleep Medicine, 1991. [38] C. H. Bastien, A. Vallieres, C. M. Morin, “Validation of the insomnia severity index as an outcome measure for insomnia research,” Journal of Sleep medicine, 2(4), 2001, pp. 297-307. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/3822 | - |
dc.description.abstract | 本研究的目的,在提供睡眠自我檢測的客觀量測工具,並提出應用於蓋被情境的睡姿辨識方法。醫學上的睡眠多項生理檢查,需要使用接觸式的設備,取得生理訊號資訊;然而接觸式的設備可能影響睡眠,且檢查的費用昂貴。本研究設計非接觸式的睡眠瀏覽系統,採用普及的深度攝影機設備,方便於居家使用。目前採用影像處理的睡姿辨識方法,在未蓋被情況下進行睡姿分類,無法應用於真實睡眠情境。使用深度影像的三維訊息,本研究實現在蓋被情況下進行睡姿辨識的方法。
本研究提出時間區間的方法用於偵測睡眠事件,基於深度資訊的睡姿辨識方法用於分類睡姿。睡眠瀏覽系統採用具有多重感測器的裝置,偵測床上的使用者及周遭環境中發生的睡眠事件。裝置包含紅外線深度感測器、彩色攝影機及麥克風陣列,分別偵測三種睡眠事件:動作事件、光照事件及聲音事件。由輸入的深度訊號流及彩色影像流,系統建立背景模型,偵測動作變化及光照變化,並同步量化三種訊號。當訊號分數超過各別的實驗門檻值,即觸發時間區間的方法,紀錄各別的睡眠事件,紀錄的內容包含深度影像、彩色影像及聲音檔案。系統提供睡眠歷程的瀏覽介面,呈現睡眠事件的分數曲線及整合後的影音檔案。睡姿偵測的方法分類四種睡姿類別:左側睡、右側睡、平躺及趴睡;其中左側睡及右側睡包含胎兒型、思念型及木頭型睡姿,平躺包含軍人型及海星型睡姿,趴睡包含木頭型和自由落體型睡姿。在實驗前測階段,為了計算床平面,將記錄空床的深度影像轉換為世界座標系。將每張記錄使用者的深度影像轉換為世界座標系,計算每個深度點至床平面的距離。將每張深度影像的距離陣列做為輸入,採用支持向量機的機器學習方法,實現睡姿分類。實驗模擬真實睡眠情境,在三種條件下進行,沒蓋被狀態、蓋薄被狀態及蓋厚被狀態。 本研究結果顯示:(1)睡眠瀏覽系統具有效率及可靠性,使用者透過本系統快速瀏覽睡眠事件紀錄,並經由觀看影片檢視睡眠事件的內容。(2)睡姿辨識方法在厚被的條件下,比未蓋被和薄毯的條件下有更好的辨識結果,因為厚被的厚度增強睡姿動作的特徵。本研究的發現可作為未來在居家情境中,進行睡眠事件偵測及睡姿辨識研究的指南。 | zh_TW |
dc.description.abstract | The purpose of the study was to provide an objective measurement tool for sleep self-examination, and to propose a method for sleep posture recognition of a subject under covering. Polysomnography (PSG) in clinical therapy requires attached devices to obtain bioinformation; however, the attached devices may result in uncomfortable sleeping, and the cost of the examination is expensive. In the study, using a common depth camera device, an unconstrained sleep browsing system has been developed for applying to home scenario. Current methods based on image processing technique in sleep posture recognition, classified sleep postures in the condition of a subject without covering, and were unable to apply to real sleep scenario. Using three-dimensional information of depth image, a method of sleep posture recognition was realized in the condition of a subject under covering.
In the study, epoch method was proposed for recording sleep events, and a method of sleep posture recognition based on depth image was proposed for classifying sleep postures. Using a device with multiple sensors, the sleep browsing system detected sleep events from a subject in bed and the surrounding environment. Based on the multiple sensors of the device, including an infrared depth camera, a color camera, and a four-microphone array, three types of sleep events were detected: motion event, lighting event and sound event. From the input of depth image stream and the input of color image stream, background modeling in the system was used to measure body movements and lighting changes, and the three types of signals were quantified simultaneously. When type of signal score was greater than each empirical threshold, the epoch method was triggered for recording independent sleep events, and the recording contained depth images, color images and audio files. The system provided a browsing interface with sleep diagram, presenting the score curves of sleep events and integrated videos. The method of sleep posture recognition classified sleep postures into four classes: left side, right side, supine and stomach, in which left side and right side contained fetus, yearner and log types of sleep postures, supine contained soldier and starfish types of sleep postures, and stomach contained log and freefaller types of sleep postures. In preliminary stage, the depth image capturing an empty bed was transformed into world coordinate for calculating the bed plane. Each depth image capturing a subject was transformed into world coordinate, and the vertical distance of each depth pixel to the bed plane was calculated. From the input distance array of each depth image, the Support Vector Machine (SVM) method was adopted for classifying sleep postures. Experiments for simulating real sleep scenario with three conditions were carried out: without covering condition, blanket covering condition and quilt covering condition. The survey concluded: (1) The sleep browsing system had efficiency and reliability that users browsed the recording of sleep events efficiently, and examined the content of sleep events by watching the videos. (2) The method of sleep posture recognition had a better performance in quilt covering condition than without covering condition and blanket covering condition, because the layer of quilt enhances the features of sleep postures. The study findings may serve as a guide for future research on sleep event detection and sleep posture recognition in home scenario. | en |
dc.description.provenance | Made available in DSpace on 2021-05-13T08:37:10Z (GMT). No. of bitstreams: 1 ntu-105-D96944006-1.pdf: 1777228 bytes, checksum: 49cfbe919cd6edcedb72eaf5ee7c99e4 (MD5) Previous issue date: 2016 | en |
dc.description.tableofcontents | 口試委員審定書…………………………………………………………..………......i
致謝 ii 摘要 iii ABSTRACT v TABLE OF CONTENTS vii TABLE OF FIGURES x TABLE OF TABLES xii CHAPTER 1 INTRODUCTION 1 1.1 Background and Motivation 1 1.2 Outline of this Research 3 1.2.1 Sleep Browsing System for Sleep Event Detection and Browsing 3 1.2.2 Sleep Posture Recognition Based on Depth Image 3 1.3 Organization of the Dissertation 4 CHAPTER 2 RELATED WORK 5 2.1 Constrained versus Unconstrained Sleep Detection 5 2.2 Constrained versus Unconstrained Sleep Posture Recognition 6 2.3 Summary 8 CHAPTER 3 SLEEP BROWSING SYSTEM FOR SLEEP EVENT DETECTION AND BROWSING 9 3.1 Sleep Event Type 9 3.2 System Overview 10 3.2.1 System Setup 10 3.2.2 System Flow 11 3.3 Sleep Event Detection and Recording 11 3.3.1 Background Modeling 12 3.3.2 Empirical Threshold of Sleep Event 13 3.3.3 Motion Threshold Adjustment 14 3.3.4 Epoch Method 15 3.3.5 Sleep Diagram for Browsing Sleep Events 17 3.4 Experiments on Overnight Sleep 19 3.4.1 Sleep/Wake Identification 20 3.4.2 Experiments on Discovering Sleep Events 21 3.4.3 Experiments on Sleep Quality Evaluation 23 3.5 Summary 28 CHAPTER 4 SLEEP POSTURE RECOGNITION BASED ON DEPTH IMAGE 29 4.1 Sleep Posture Type 29 4.2 Sleep Posture Recognition 29 4.3 Experiments on Sleep Posture Recognition 30 4.3.1 Experimental Setup 31 4.3.2 Sleep Posture Feature 31 4.3.3 36-fold Cross Validation 37 4.4 Summary 50 CHAPTER 5 CONCLUSION AND FUTURE WORK 52 5.1 Summary of the Dissertation 52 5.2 Future Directions 53 LIST OF REFERENCES 54 | |
dc.language.iso | en | |
dc.title | 睡眠事件之偵測與瀏覽 | zh_TW |
dc.title | On Detection and Browsing of Sleep Events | en |
dc.type | Thesis | |
dc.date.schoolyear | 104-2 | |
dc.description.degree | 博士 | |
dc.contributor.oralexamcommittee | 賴飛羆,陳永昇,唐玄輝,陳冠文 | |
dc.subject.keyword | 深度影像,影像序列分析,睡眠瀏覽,非接觸式睡眠事件偵測,睡姿辨識, | zh_TW |
dc.subject.keyword | Depth image,image sequence analysis,sleep browsing,unconstrained sleep event detection,sleep posture recognition, | en |
dc.relation.page | 71 | |
dc.identifier.doi | 10.6342/NTU201601713 | |
dc.rights.note | 同意授權(全球公開) | |
dc.date.accepted | 2016-08-02 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 資訊網路與多媒體研究所 | zh_TW |
顯示於系所單位: | 資訊網路與多媒體研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-105-1.pdf | 1.74 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。