請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/96025完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 傅立成 | zh_TW |
| dc.contributor.advisor | Li-Chen Fu | en |
| dc.contributor.author | 廖郁珊 | zh_TW |
| dc.contributor.author | Yu-Shan Liao | en |
| dc.date.accessioned | 2024-09-25T16:40:33Z | - |
| dc.date.available | 2024-09-26 | - |
| dc.date.copyright | 2024-09-25 | - |
| dc.date.issued | 2024 | - |
| dc.date.submitted | 2024-08-09 | - |
| dc.identifier.citation | [1] Amjad Z Alrosan, Ghaith B Heilat, Khaled Alrosan, Abrar A Aleikish, Aya N Rabbaa, Aseel M Shakhatreh, Ehab M Alshalout, and Enaam MA Al Momany. Autonomic brain functioning and age-related health concerns. Current research in physiology, page 100123, 2024.
[2] Reisa A Sperling, Paul S Aisen, Laurel A Beckett, David A Bennett, Suzanne Craft, Anne M Fagan, Takeshi Iwatsubo, Clifford R Jack Jr, Jeffrey Kaye, Thomas J Montine, et al. Toward defining the preclinical stages of alzheimer＇s disease: Recommendations from the national institute on aging alzheimer’s association workgroups on diagnostic guidelines for alzheimer’s disease. Alzheimer’s & dementia, 7(3):280–292, 2011. [3] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017. [4] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, 2019. [5] Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, and Michael Auli. wav2vec 2.0: A framework for self-supervised learning of speech representations. Advances in neural information processing systems, 33:12449–12460, 2020. [6] Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. A simple framework for contrastive learning of visual representations. In International conference on machine learning, pages 1597–1607. PMLR, 2020. [7] Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. Supervised contrastive learning. Advances in neural information processing systems, 33:18661–18673, 2020. [8] Harold Goodglass, Edith Kaplan, and Sandra Weintraub. BDAE: The Boston diagnostic aphasia examination. Lippincott Williams & Wilkins Philadelphia, PA, 2001. [9] Victor L Villemagne, Samantha Burnham, Pierrick Bourgeat, Belinda Brown, Kathryn A Ellis, Olivier Salvado, Cassandra Szoeke, S Lance Macaulay, Ralph Martins, Paul Maruff, et al. Amyloid β deposition, neurodegeneration, and cognitive decline in sporadic alzheimer’s disease: a prospective cohort study. The Lancet Neurology, 12(4):357–367, 2013. [10] Brenda L Plassman, Kenneth M Langa, Gwenith G Fisher, Steven G Heeringa, David R Weir, Mary Beth Ofstedal, James R Burke, Michael D Hurd, Guy G Potter, Willard L Rodgers, et al. Prevalence of dementia in the united states: the aging, demographics, and memory study. Neuroepidemiology, 29(1-2):125–132, 2007.[11] 2023 alzheimer’s disease facts and figures. Alzheimer’s & Dementia, 19(4):1598–1695, 2023. [12] Arindam Nandi, Nathaniel Counts, Simiao Chen, Benjamin Seligman, Daniel Tortorice, Daniel Vigo, and David E Bloom. Global and regional projections of the economic burden of alzheimer’s disease and related dementias from 2019 to 2050: a value of statistical life approach. EClinicalMedicine, 51, 2022. [13] Ronald C Petersen, Rachelle Doody, Alexander Kurz, Richard C Mohs, John C Morris, Peter V Rabins, Karen Ritchie, Martin Rossor, Leon Thal, and Bengt Winblad. Current concepts in mild cognitive impairment. Archives of neurology, 58(12):1985–1992, 2001. [14] Maddalena Bruscoli and Simon Lovestone. Is mci really just early dementia? a systematic review of conversion studies. International psychogeriatrics, 16(2):129–140, 2004. [15] Pan Chen, Hong Cai, Wei Bai, Zhaohui Su, Yi-Lang Tang, Gabor S Ungvari, Chee H Ng, Qinge Zhang, and Yu-Tao Xiang. Global prevalence of mild cognitive impairment among older adults living in nursing homes: a meta-analysis and systematic review of epidemiological surveys. Translational Psychiatry, 13(1):88, 2023. [16] Maija Pihlajamaki, Anne M Jauhiainen, and Hilkka Soininen. Structural and functional mri in mild cognitive impairment. Current Alzheimer Research, 6(2):179–185, 2009. [17] Jeff Sevigny, Joyce Suhy, Ping Chiao, Tianle Chen, Gregory Klein, Derk Purcell, Joonmi Oh, Ajay Verma, Mehul Sampat, and Jerome Barakos. Amyloid pet screening for enrichment of early-stage alzheimer disease clinical trials: experience in a phase 1b clinical trial. Alzheimer Disease & Associated Disorders, 30(1):1–7, 2016. [18] K Blennow. Csf biomarkers for mild cognitive impairment. Journal of internal medicine, 256(3):224–234, 2004. [19] Ziad S Nasreddine, Natalie A Phillips, Valérie Bédirian, Simon Charbonneau, Victor Whitehead, Isabelle Collin, Jeffrey L Cummings, and Howard Chertkow. The montreal cognitive assessment, moca: a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4):695–699, 2005. [20] Ingrid Arevalo-Rodriguez, Nadja Smailagic, Marta Roqué i Figuls, Agustín Ciapponi, Erick Sanchez-Perez, Antri Giannakou, Olga L Pedraza, Xavier Bonfill Cosp, and Sarah Cullum. Mini-mental state examination (mmse) for the detection of alzheimer’s disease and other dementias in people with mild cognitive impairment (mci). Cochrane database of systematic reviews, (3), 2015. [21] Emma Nichols, Jaimie D Steinmetz, Stein Emil Vollset, Kai Fukutaki, Julian Chalek, Foad Abd-Allah, Amir Abdoli, Ahmed Abualhasan, Eman Abu-Gharbieh, Tayyaba Tayyaba Akram, et al. Estimation of the global prevalence of dementia in 2019 and forecasted prevalence in 2050: an analysis for the global burden of disease study 2019. The Lancet Public Health, 7(2):e105–e125, 2022. [22] Hiral Shah, Emiliano Albanese, Cynthia Duggan, Igor Rudan, Kenneth M Langa, Maria C Carrillo, Kit Yee Chan, Yves Joanette, Martin Prince, Martin Rossor, et al. Research priorities to reduce the global burden of dementia by 2025. The Lancet Neurology, 15(12):1285–1294, 2016. [23] Anders Wimo, L Jönsson, A Gustavsson, David McDaid, K Ersek, J Georges, L Gulacsi, K Karpati, P Kenigsberg, and H Valtonen. The economic impact of dementia in europe in 2008—cost estimates from the eurocode project. International journal of geriatric psychiatry, 26(8):825–832, 2011. [24] Wei Chen and Huali Wang. Mild cognitive impairment: a concept useful for early detection and intervention of dementia. Shanghai archives of psychiatry, 25(2):119, 2013. [25] Dale S Sherman, Justin Mauser, Miriam Nuno, and Dean Sherzai. The efficacy of cognitive intervention in mild cognitive impairment (mci): a meta-analysis of outcomes on neuropsychological measures. Neuropsychology review, 27:440–484, 2017. [26] Kimberly D Mueller, Bruce Hermann, Jonilda Mecollari, and Lyn S Turkstra. Connected speech and language in mild cognitive impairment and alzheimer＇s disease: A review of picture description tasks. Journal of clinical and experimental neuropsychology, 40(9):917–939, 2018. [27] Carole Roth. Boston Diagnostic Aphasia Examination, pages 428–430. Springer New York, New York, NY, 2011. [28] Saturnino Luz, Fasih Haider, Sofia de la Fuente, Davida Fromm, and Brian MacWhinney. Alzheimer’s dementia recognition through spontaneous speech: The ADReSS Challenge. In Proceedings of INTERSPEECH 2020, Shanghai, China, 2020. [29] Muhammad Shehram Shah Syed, Zafi Sherhan Syed, Margaret Lech, and Elena Pirogova. Automated screening for alzheimer’s dementia through spontaneous speech. In Interspeech, volume 2020, pages 2222–6, 2020. [30] Felix Agbavor and Hualou Liang. Predicting dementia from spontaneous speech using large language models. PLOS Digital Health, 1(12):e0000168, 2022. [31] R’mani Haulcy and James Glass. Classifying alzheimer’s disease using audio and text-based representations of speech. Frontiers in Psychology, 11:624137, 2021. [32] Brian Levine, Eva Svoboda, Janine FHay, Gordon Winocur, and Morris Moscovitch. Aging and autobiographical memory: dissociating episodic from semantic retrieval. Psychology and aging, 17(4):677, 2002. [33] Sheng-Ya Lin. Contrast-enhanced automatic cognitive impairment detection system embedded with pause encoding. Master’s thesis, National Taiwan University, 2022. [34] Ho-LingChang.Multi-modalearlycognitiveimpairmentdetectionsystemforspon- taneous speech using deep learning. Master’s thesis, National Taiwan University, 2023. [35] YenYingLim,JessicaKong,PMaruff,JJaeger,EllenHuang,andElenaRatti.Lon- gitudinal cognitive decline in patients with mild cognitive impairment or dementia due to alzheimer's disease. The Journal of Prevention of Alzheimer’s Disease, pages 1–6, 2022. [36] Kathryn A Ellis, Ashley I Bush, David Darby, Daniela De Fazio, Jonathan Foster, Peter Hudson, Nicola T Lautenschlager, Nat Lenzo, Ralph N Martins, Paul Maruff, et al. The australian imaging, biomarkers and lifestyle (aibl) study of aging: method- ology and baseline characteristics of 1112 individuals recruited for a longitudinal study of alzheimer’s disease. International psychogeriatrics, 21(4):672–687, 2009. [37] Nicole D Anderson. State of the science on mild cognitive impairment (mci). CNS spectrums, 24(1):78–87, 2019. [38] I Driscoll, C Davatzikos, Y An, X Wu, D Shen, M Kraut, and SM2690968 Resnick. Longitudinal pattern of regional brain volume change differentiates normal aging from mci. Neurology, 72(22):1906–1913, 2009. [39] WillemHuijbers,ElizabethCMormino,AaronPSchultz,SarahWigman,AndrewM Ward, Mykol Larvie, Rebecca E Amariglio, Gad A Marshall, Dorene M Rentz, Keith A Johnson, et al. Amyloid-β deposition in mild cognitive impairment is asso- ciated with increased hippocampal activity, atrophy and clinical progression. Brain, 138(4):1023–1035, 2015. [40] Lisa Mosconi. Brain glucose metabolism in the early and specific diagnosis of alzheimer's disease: Fdg-pet studies in mci and ad. European journal of nuclear medicine and molecular imaging, 32:486–510, 2005. [41] Pimarn Kantithammakorn, Proadpran Punyabukkana, Ploy N Pratanwanich, So- laphat Hemrungrojn, Chaipat Chunharas, and Dittaya Wanvarie. Using automatic speech recognition to assess thai speech language fluency in the montreal cognitive assessment (moca). Sensors, 22(4):1583, 2022. [42] MatteoLuperto,MartaRomeo,FrancescaLunardini,NicolaBasilico,CarloAbbate, Ray Jones, Angelo Cangelosi, Simona Ferrante, and N Alberto Borghese. Evaluat- ing the acceptability of assistive robots for early detection of mild cognitive impair- ment. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1257–1264. IEEE, 2019. [43] Pegah Hafiz, Kamilla Woznica Miskowiak, Lars Vedel Kessing, Andreas Elleby Jespersen, Kia Obenhausen, Lorant Gulyas, Katarzyna Żukowska, Jakob Eyvind Bardram, et al. The internet-based cognitive assessment tool: System design and feasibility study. JMIR formative research, 3(3):e13898, 2019. [44] Bahman Mirheidari, Daniel Blackburn, Ronan O'Malley, Traci Walker, Annalena Venneri, Markus Reuber, and Heidi Christensen. Computational cognitive as- sessment: Investigating the use of an intelligent virtual agent for the detection of early signs of dementia. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 2732–2736. IEEE, 2019. [45] Saturnino Luz, Fasih Haider, Sofia de la Fuente, Davida Fromm, and Brian MacWhinney. Detecting cognitive decline using speech only: The adresso chal- lenge. arXiv preprint arXiv:2104.09356, 2021. [46] Saturnino Luz, Sofie de la Fuente Garcia, Fasih Haider, Davida Fromm, Brian MacWhinney, Alyssa Lanzi, Ya-Ning Chang, Chia-Ju Chou, and Yi-Chien Liu. Con- nected speech-based cognitive assessment in chinese and english, 2024. Final DOI to be assigned. [47] Saturnino Luz, Fasih Haider, Davida Fromm, Ioulietta Lazarou, Ioannis Kompat- siaris, and Brian MacWhinney. Multilingual alzheimer’s dementia recognition through spontaneous speech: A signal processing grand challenge. arXiv preprint arXiv:2301.05562, 2023. [48] Ayaka Yamanaka, Ikuma Sato, Shuichi Matsumoto, and Yuichi Fujino. Mild cognitive impairment screening system by multiple daily activity information—a method based on daily conversation. In International Congress on Information and Communication Technology, pages 349–360. Springer, 2023. [49] LászlóTóth,IldikóHoffmann,GáborGosztolya,VeronikaVincze,GrétaSzatlóczki, Zoltán Bánréti, Magdolna Pákáski, and János Kálmán. A speech recognition-based solution for the automatic detection of mild cognitive impairment from spontaneous speech. Current Alzheimer Research, 15(2):130–138, 2018. [50] Liu Chen, Hiroko H Dodge, and Meysam Asgari. Topic-based measures of conver- sation for detecting mild cognitive impairment. In Proceedings of the conference. Association for Computational Linguistics. Meeting, volume 2020, page 63. NIH Public Access, 2020. [51] Michel Galley, Kathleen McKeown, Eric Fosler-Lussier, and Hongyan Jing. Dis- course segmentation of multi-party conversation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 562–569, 2003. [52] Sabah Al-Hameed, Mohammed Benaissa, and Heidi Christensen. Detecting and predicting alzheimer’s disease severity in longitudinal acoustic data. In Proceedings of the 4th International Conference on Bioinformatics Research and Applications, pages 57–61, 2017. [53] RandaBenAmmarandYassineBenAyed.Alanguage-basedapproachforpredicting alzheimer disease severity. In International Conference on Research Challenges in Information Science, pages 283–294. Springer, 2021. [54] Jordi Laguarta and Brian Subirana. Longitudinal speech biomarkers for automated alzheimer’s detection. frontiers in Computer Science, 3:624694, 2021. [55] Yasunori Yamada, Kaoru Shinkawa, Keita Shimmei, et al. Atypical repetition in daily conversation on different days for detecting alzheimer disease: evaluation of phone-call data from a regular monitoring service. JMIR mental health, 7(1):e16790, 2020. [56] Florian Eyben, Klaus R Scherer, Björn W Schuller, Johan Sundberg, Elisabeth André, Carlos Busso, Laurence Y Devillers, Julien Epps, Petri Laukka, Shrikanth S Narayanan, et al. The geneva minimalistic acoustic parameter set (gemaps) for voice research and affective computing. IEEE transactions on affective computing, 7(2):190–202, 2015. [57] Sercan Ö Arik and Tomas Pfister. Tabnet: Attentive interpretable tabular learning. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 6679–6687, 2021. [58] Vinod Nair and Geoffrey E Hinton. Rectified linear units improve restricted boltz- mann machines. In Proceedings of the 27th international conference on machine learning (ICML-10), pages 807–814, 2010. [59] DanHendrycksandKevinGimpel.Gaussianerrorlinearunits(gelus).arXivpreprint arXiv:1606.08415, 2016. [60] Geoffrey Hinton, Li Deng, Dong Yu, George E Dahl, Abdel-rahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara N Sainath, et al. Deep neural networks for acoustic modeling in speech recogni- tion: The shared views of four research groups. IEEE Signal processing magazine, 29(6):82–97, 2012. [61] Sebastian Ruder. An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747, 2016. [62] Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014. [63] IlyaLoshchilovandFrankHutter.Fixingweightdecayregularizationinadam.2018. [64] Florian Schroff, Dmitry Kalenichenko, and James Philbin. Facenet: A unified em- bedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 815–823, 2015. [65] Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momen- tum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9729– 9738, 2020. [66] Thomas Leyhe, Stephan Müller, Monika Milian, Gerhard W. Eschweiler, and Ralf Saur. Impairment of episodic and semantic autobiographical memory in patients with mild cognitive impairment and early alzheimer’s disease. Neuropsychologia, 47(12):2464–2469, 2009. [67] NadjaUrbanowitsch,LinaGorenc,ChristinaJHerold,andJohannesSchröder.Auto- biographical memory: a clinical perspective. Frontiers in Behavioral Neuroscience, 7:194, 2013. [68] JiahongYuan,XingyuCai,YuchenBian,ZhengYe,andKennethChurch.Pausesfor detection of alzheimer's disease. Frontiers in Computer Science, 2:624488, 2021. [69] A.Pistono,J.Pariente,C.Bézy,B.Lemesle,J.LeMen,andM.Jucla.Whathappens when nothing happens? an investigation of pauses as a compensatory mechanism in early alzheimer’s disease. Neuropsychologia, 124:133–143, 2019. [70] PatriciaPastoriza-Dominguez,IvanGTorre,FaustinoDieguez-Vide,IsabelGómez- Ruiz, Sandra Geladó, Joan Bello-López, Asunción Ávila-Rivera, Jordi A Matias- Guiu, Vanesa Pytel, and Antoni Hernández-Fernández. Speech pause distribution as an early marker for alzheimer's disease. Speech Communication, 136:107–117, 2022. [71] Kimberly D Mueller, Rebecca L Koscik, Bruce P Hermann, Sterling C Johnson, and Lyn S Turkstra. Declines in connected language are associated with very early mild cognitive impairment: Results from the wisconsin registry for alzheimer's prevention. Frontiers in Aging Neuroscience, 9:437, 2018. [72] Sirikorn Sangchocanonta, Sethavudh Vongsurakrai, Kanyaporn Sroykhumpa, V Ellermann, Adirek Munthuli, Thanaporn Anansiripinyo, Chutamanee Onsuwan, Solaphat Hemrungrojn, Krit Kosawat, and Charturong Tantibundhit. Development of thai picture description task for alzheimer's screening using part-of-speech tag- ging. In 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pages 2104–2109. IEEE, 2021. [73] FabriceBerna,PeterSchönknecht,UlrichSeidl,PabloToro,andJohannesSchröder. Episodic autobiographical memory in normal aging and mild cognitive impairment: A population-based study. Psychiatry Research, 200(2):807–812, 2012. [74] Muireann Irish, Brian A Lawlor, Shane M O’Mara, and Robert F Coen. Im- paired capacity for autonoetic reliving during autobiographical event recall in mild alzheimer’s disease. Cortex, 47(2):236–249, 2011. [75] Jiahong Ouyang, Qingyu Zhao, Ehsan Adeli, Edith V Sullivan, Adolf Pfeffer- baum, Greg Zaharchuk, and Kilian M Pohl. Self-supervised longitudinal neighbourhood embedding. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part II 24, pages 80–89. Springer, 2021. [76] Qingyu Zhao, Zixuan Liu, Ehsan Adeli, and Kilian M Pohl. Longitudinal self- supervised learning. Medical image analysis, 71:102051, 2021. [77] Zafi Sherhan Syed, Muhammad Shehram Shah Syed, Margaret Lech, and Elena Pirogova. Tackling the adresso challenge 2021: The muet-rmit system for alzheimer’s dementia recognition from spontaneous speech. In Interspeech, pages 3815–3819, 2021. [78] MortezaRohanian,JulianHough,andMatthewPurver.Alzheimer’sdementiarecog- nition using acoustic, lexical, disfluency and speech pause features robust to noisy inputs. arXiv preprint arXiv:2106.15684, 2021. [79] Youxiang Zhu, Abdelrahman Obyat, Xiaohui Liang, John A Batsis, and Robert M Roth. Wavbert: Exploiting semantic and non-semantic speech using wav2vec and bert for dementia detection. In Interspeech, volume 2021, page 3790. NIH Public Access, 2021. [80] YangweiYing, TaoYang, and HongZhou. Multimodal fusion for alzheimer's disease recognition. Applied Intelligence, 53(12):16029–16040, 2023. | - |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/96025 | - |
| dc.description.abstract | 近年來，隨著人口老化現象顯著增長，認知疾病的發病率也隨之增加。在這一系列疾病中，阿茲海默症佔據了相當大的比例，對醫療系統造成了高成本的負擔。為了及早進行治療，延緩患者的退化過程，及時診斷出中間狀態的輕度認知障礙（MCI）是非常重要的。在本論文中，我們利用自傳式記憶測驗的語音資料，建立了一套針對MCI的雙模態縱向認知檢測系統。自傳式記憶測驗是一種評估受試者認知的心理學測驗模式，受試者在測驗過程中會自由講述其人生中的重要經歷。相比傳統測驗，在非結構化的自發性語音中找到隱含的疾病資訊更具挑戰性。在我們的研究中，我們從語音和文字的角度切入資料，提供更豐富的線索來判斷受試者的認知狀態。此外，為了捕捉自發性語音在不同時間點的認知變化，我們提出了老化軌跡模組計算局部與全局的對齊損失函數，通過對齊認知變化的方式增強時間變化上的特徵學習。在我們的中文數據集實驗中，包含老化軌跡模組的模型在多時間點數據集中的兩種資料上AUROC分別達到了85%和89%，相比單時間點的模型有了顯著的進步，同時我們也進行消融實驗，驗證提出了老化軌跡模組的必要性。為了證實模型不僅適用於自傳式記憶測驗資料，我們也將模型的一部分應用於單時間點的半結構化資料上進行驗證，結果顯示模型的正確率均超過78%。 | zh_TW |
| dc.description.abstract | In recent years, the incidence of cognitive diseases has also risen with the significant increase in population aging. Among these diseases, Alzheimer's disease constitutes a substantial proportion, placing a high-cost burden on healthcare systems. To give early treatment and slow the progression of patient deterioration, it is crucial to diagnose Mild Cognitive Impairment (MCI), a transitional stage. In this thesis, we utilize autobiographical memory (AM) test speech data to establish a dual-modal longitudinal cognitive detection system for MCI. The AM test is a psychological assessment method that evaluates the cognitive status of subjects as they freely narrate important life experiences. Identifying hidden disease information in unstructured, spontaneous speech is more challenging than traditional tests.
In our study, we analyze data from both speech and text perspectives, providing richer clues to assess the cognitive state of the subjects. Additionally, to capture cognitive changes in spontaneous speech over different time points, we propose an aging trajectory module that calculates local and global alignment loss functions, enhancing temporal feature learning by aligning cognitive changes over time. In our experiments on the Chinese dataset, the model incorporating the aging trajectory module achieved AUROC of 85% and 89% on two data, respectively, showing significant improvement over single time-point models. We also conducted ablation studies to verify the necessity of the proposed aging trajectory module. To confirm that the model not only applies to autobiographical memory test data, we used part of the model to single time-point semi-structured data for validation, with results showing an accuracy exceeding 78%. | en |
| dc.description.provenance | Submitted by admin ntu (admin@lib.ntu.edu.tw) on 2024-09-25T16:40:33Z No. of bitstreams: 0 | en |
| dc.description.provenance | Made available in DSpace on 2024-09-25T16:40:33Z (GMT). No. of bitstreams: 0 | en |
| dc.description.tableofcontents | 誌謝 i
中文摘要 iii Abstract iv Contents vi List of Figures x List of Tables xii Chapter 1 Introduction 1 1.1 Background 1 1.2 Motivation 4 1.3 Challenges 6 1.3.1 Unstructured Speech Data 6 1.3.2 Cognitive Decline in the Speech is Implicit 6 1.3.3 Effectively Extract the Relation between Visits is Difficult 7 1.4 Related Work 7 1.4.1 Speech-based Cognitive Detection Method 7 1.4.2 Longitudinal Analysis 9 1.5 Objectives 11 1.6 Thesis Organization 12 Chapter 2 Preliminaries 13 2.1 Deep Learning 13 2.1.1 Neural Network 14 2.1.2 Activation Function 14 2.1.3 Loss Function 16 2.1.4 Optimizer 18 2.2 Pre-traning and Fine-tuning Paradigm 19 2.2.1 Self-attention Mechanism 20 2.2.2 Bidirectional Encoder Representations from Transformers 20 2.2.3 Wav2vec 2.0 22 2.3 Contrastive Learning 23 2.3.1 SimCLR Loss 23 2.3.2 SupCon Loss 25 Chapter 3 Methodology 26 3.1 System Overview 26 3.2 Data Collection 27 3.3 Problem Setting and Formulation 29 3.3.1 Longitudinal Problem Setting 29 3.3.2 Cross-sectional Problem Setting 30 3.4 Data Preprocessing 30 3.4.1 Acoustic Feature Extraction 31 3.4.2 Linguistic Feature Extraction 32 3.5 Longitudinal Analysis Model 35 3.5.1 Acoustic Encoder 35 3.5.2 Linguistic Encoder 36 3.5.3 Fusion Layer 37 3.5.4 Aging Trajectory Module 38 3.5.4.1 Subject Alignment Loss 40 3.5.4.2 Group Alignment Loss 42 3.5.5 Classifier and Overall Loss 43 Chapter 4 Experiments 44 4.1 Experiment Setup 44 4.1.1 Datasets 44 4.1.1.1 Details of NTU-AM 46 4.2 Evaluation Settings 47 4.2.1 Evaluation Metrics 48 4.2.2 Baselines 50 4.3 Implementation Details 50 4.4 NTU-AM-LG Dataset 51 4.4.1 Results 51 4.4.2 Ablation Study 54 4.4.3 Visualization 55 4.4.4 Discussion 58 4.5 NTU-AM-CS Dataset 58 4.5.1 Ablation Study 59 4.6 Additional Dataset 60 4.6.1 Discussion 62 4.7 Hyper-parameters 63 Chapter 5 Conclusion 65 References 68 | - |
| dc.language.iso | zh_TW | - |
| dc.title | 基於自傳式記憶測驗之雙模態縱向認知障礙檢測系統 | zh_TW |
| dc.title | Dual-modal Longitudinal Cognitive Impairment Detection System based on Autobiographical Memory Test | en |
| dc.type | Thesis | - |
| dc.date.schoolyear | 112-2 | - |
| dc.description.degree | 碩士 | - |
| dc.contributor.oralexamcommittee | 邱銘章;張玉玲;李宏毅;林澤 | zh_TW |
| dc.contributor.oralexamcommittee | Ming-Jang Chiu;Yu-Ling Chang;Hung-Yi Lee;Che Lin | en |
| dc.subject.keyword | 雙模態學習,認知分類任務,輕度認知障礙,橫向研究,縱向研究,快篩系統,非結構化自發性語音, | zh_TW |
| dc.subject.keyword | Dual-modal learning,Cognitive classification task,Mild cognitive impairment,Cross-sectional analysis,Longitudinal analysis,Screening system,Unstructured spontaneous speech, | en |
| dc.relation.page | 80 | - |
| dc.identifier.doi | 10.6342/NTU202402634 | - |
| dc.rights.note | 未授權 | - |
| dc.date.accepted | 2024-08-12 | - |
| dc.contributor.author-college | 電機資訊學院 | - |
| dc.contributor.author-dept | 資訊網路與多媒體研究所 | - |
| 顯示於系所單位： | 資訊網路與多媒體研究所 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-112-2.pdf 未授權公開取用 | 13.54 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。