請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/87548完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 劉浩澧 | zh_TW |
| dc.contributor.advisor | Hao-Li Liu | en |
| dc.contributor.author | 黃士瑜 | zh_TW |
| dc.contributor.author | Shih-Yu Huang | en |
| dc.date.accessioned | 2023-06-14T16:16:44Z | - |
| dc.date.available | 2026-02-13 | - |
| dc.date.copyright | 2023-06-14 | - |
| dc.date.issued | 2023 | - |
| dc.date.submitted | 2023-02-16 | - |
| dc.identifier.citation | [1] Sutherland Ivan E.. 1968. A head-mounted three dimensional display. In Proceedings of the December 9–11, 1968, Fall Joint Computer Conference, Part I. ACM, 757–764.
[2] Webster, A., Feiner, S., MacIntyre, B., Massie, W., and Krueger, T. (1996). “Augmented Reality in Architectural Construction, Inspection and Renovation,” in Proc. ASCE Third Congress on Computing in Civil Engineering, 996 [3] Höllerer, Tobias, Steven Feiner, Drexel Hallaway, Blaine Bell, Marco Lanzagorta, Dennis Brown, Simon Julier, Yohan Baillot, and Lawrence Rosenblum. 2001. “User Interface Management Techniques for Collaborative Mobile Augmented Reality.” Computers & Graphics 25 (5): 799–810. [4] Furlan, R.: The future of augmented reality: HoloLens—Microsoft’s AR headset shines despite rough edges Resources_Tools and Toys). IEEE Spectr. 56(6), 21 (2016) [5] Ivan Permozer and Tihomir Orehovački. 2019. Utilizing Apple ARKit 2.0 for Augmented Reality Application Development. In 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics [6] Alexandro Simonetti Ibañez and Josep Paredes Figueras. 2013. Vuforia v1. 5 SDK: Analysis and evaluation of capabilities. Master’s thesis. Universitat Politècnica de Catalunya [7] Izadi, Shahram, et al. "Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera." Proceedings of the 24th annual ACM symposium on User interface software and technology. 2011. [8] Frantz, Taylor & Jansen, Bart & Duerinck, Johnny & Vandemeulebroucke, Jef. (2018). Augmenting Microsoft’s HoloLens with Vuforia Tracking for Neuronavigation. Healthcare Technology Letters. 5. 10.1049/htl.2018.5079. [9] He W, Xi M, Gardner H, Swift B and Adcock M. (2021). Spatial Anchor Based Indoor Asset Tracking 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 10.1109/VR50410.2021.00047. 978-1-6654-1838-6. (255-259) [10] W. He, B. Swift, H. Gardner, M. Xi and M. Adcock, "Reducing latency in a collaborative augmented reality service", The 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry VRCAI '19, 2019. [11] Park, S.; Bokijonov, S.; Choi, Y. Review of Microsoft HoloLens Applications over the Past Five Years. Appl. Sci. 2021, 11, 7259. [12] Zheng-Yen, Lai, Shih-Yu, Huang, Hao-Li Liu. "Multi-User Augmented-Reality Platform for Medical Interventional Applications", The 4th IEEE Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability 2022. [13] Camilo, A.A.; Amorim, P.H.; de Moraes, T.F.; Azevedo, F.D.S.; da Silva J.V. InVesalius: Medical image edition. In Proceedings of the 1st International Conference on Design and Processes for Medical Devices, Brescia, Italy, 2–4 May 2012; pp. 279–282. [14] Gerardin E.: Morphometry of the human hippocampus from MRI and conventional MRI high field. Université Paris Sud-Paris XI, 2012. English. ffNNT: 2012PA112375ff. [15] McNeely, A. A., Ramirez, J., Nestor, S. M., Zhao, J., Gao, F., Kiss, A., et al. (2015). Cholinergic subcortical hyperintensities in Alzheimer’s disease patients from the Sunnybrook Dementia Study: relationships with cognitive dysfunction and hippocampal atrophy. J. Alzheimers Dis. 43, 785–796. doi: 10.3233/JAD-1 40588 [16] Koulaxidis, G.; Xinogalos, S. Improving Mobile Game Performance with Basic Optimization Techniques in Unity. Modelling 2022, 3, 201-223. [17] J. Jie, K. Yang and S. Haihui, "Research on the 3d game scene optimization of mobile phone based on the unity 3d engine", 2011 International Conference on Computational and Information Sciences, pp. 875-877, 2011. [18] Hololens (1st gen) hardware [online]. available:https://docs.microsoft.com/en-us/hololens/hololens1-hardware [19] Module size vs Detectable ranges [online]. available: https://docs.microsoft.com/zh-tw/windows/mixed-reality/develop/advanced-concepts/qr-code-tracking-overview [20] V. S. Nguyen, M. H. Tran and H. M. Quang Vu, "A Research on 3D Model Construction from 2D DICOM," 2016 International Conference on Advanced Computing and Applications (ACOMP), 2016, pp. 158-163, doi: 10.1109/ACOMP.2016.031. [21] Molina CA, Theodore N, Ahmed AK, Westbroek EM, Mirovsky Y, Harel R, Orru' E, Khan M, Witham T, Sciubba DM. Augmented reality-assisted pedicle screw insertion: a cadaveric proof-of-concept study. J Neurosurg Spine. 2019 Mar 29:1-8. doi: 10.3171/2018.12.SPINE181142. Epub ahead of print. PMID: 30925479. [22] Jakl, Andreas, et al. "Augmented Reality for Industry 4.0: Architecture and User Experience." FMT. 2018. [23] S. Nicolau, X. Pennec, L. Soler, and N. Ayache, “An augmented reality system to guide liver punctures,” in Workshop AMIARCS, 2004. [24] Nicolau, Stéphane & Pennec, Xavier & Soler, Luc & Ayache, Nicholas. (2005). A Complete Augmented Reality Guidance System for Liver Punctures: First Clinical Evaluation. Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention. 8. 539-47. 10.1007/11566465_67. [25] Parmar, D., Pelmahale, K., Kothwade, R., Badguajar, P.: Augmented reality system for engineering graphics. Int. J. Adv. Res. Comput. Commun. Eng. 4(10), 327–330 (2015) [26] H. Le, M. Nguyen and W. Q. Yan, "CSPM: A Novel Curtain Style Pictorial Marker for Enhancing Augmented Reality Experiences," 2018 International Conference on Image and Vision Computing New Zealand (IVCNZ), 2018, pp. 1-6, doi: 10.1109/IVCNZ.2018.8634697. [27] Solbiati M, Ierace T, Muglia R, Pedicini V, Iezzi R, Passera KM, Rotilio AC, Goldberg SN, Solbiati LA. Thermal Ablation of Liver Tumors Guided by Augmented Reality: An Initial Clinical Experience. Cancers (Basel). 2022 Mar 3;14(5):1312. doi: 10.3390/cancers14051312. PMID: 35267620; PMCID: PMC8909771 [28] https://www.afjv.com/news/10173_xr-hardware-and-consumer-software-will-earn-6-3b-in-2020.htm. [29] 肝穿刺的概述圖https://baike.baidu.com/item/%E8%82%9D%E7%A9%BF%E5%88%BA/2284403 [30] Dibble CF, Molina CA. Device profile of the XVision-spine (XVS) augmented-reality surgical navigation system: overview of its safety and efficacy. Expert Rev Med Devices. 2021 Jan;18(1):1-8. doi: 10.1080/17434440.2021.1865795. Epub 2020 Dec 24. PMID: 33322948. [31] Fishman, P.S., Elias, W.J., Ghanouni, P., Gwinn, R., Lipsman, N., Schwartz, M., Chang, J.W., Taira, T., Krishna, V., Rezai, A., Yamada, K., Igase, K., Cosgrove, R., Kashima, H., Kaplitt, M.G., Tierney, T.S. and Eisenberg, H.M. (2018), Neurological adverse event profile of magnetic resonance imaging–guided focused ultrasound thalamotomy for essential tremor. Mov Disord., 33: 843-847. https://doi.org/10.1002/mds.27401 [32] Roberts JW, Powlovich L, Sheybani N, LeBlang S. Focused ultrasound for the treatment of glioblastoma. J Neurooncol. 2022 Apr;157(2):237-247. doi: 10.1007/s11060-022-03974-0. Epub 2022 Mar 10. PMID: 35267132; PMCID: PMC9021052. [33] Chen KT, Lin YJ, Chai WY, Lin CJ, Chen PY, Huang CY, Kuo JS, Liu HL, Wei KC. Neuronavigation-guided focused ultrasound (NaviFUS) for transcranial blood-brain barrier opening in recurrent glioblastoma patients: clinical trial protocol. Ann Transl Med. 2020 Jun;8(11):673. doi: 10.21037/atm-20-344. PMID: 32617293; PMCID: PMC7327352. [34] O. Güler and Z. Yaniv, “Image-guided navigation: a cost effective practical introduction using the image-guided surgery toolkit (igstk),” Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Conference, vol. 2012, pp. 6056–9, 08 2012. [35] E. Basafa, M. Hoßbach, and P. Stolka, “Fast, intuitive, vision-based: Performance metrics for visual registration, instrument guidance, and image fusion,” 10 2016, pp. 9–17. [36] Bettati P, Chalian M, Huang J, Dormer JD, Shahedi M, Fei B. Augmented Reality-Assisted Biopsy of Soft Tissue Lesions. Proc SPIE Int Soc Opt Eng. 2020 Feb;11315:113150W. doi: 10.1117/12.2549381. Epub 2020 Mar 16. PMID: 32528216; PMCID: PMC7289183. [37] Lugano, F., Bergamin, I., Meyer-Herbon, P., Hechelhammer, L., & Semela, D. (2022). Mixed reality for ultrasound-guided biopsies and ablations of liver tumors: proof of concept using HoloLens as head-mounted display during liver interventions. Journal of Hepatology, 77, S937-S938. | - |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/87548 | - |
| dc.description.abstract | 擴增實境(Augmented Reality, AR)是一項嶄新的技術，其允許使用者透過一個頭戴裝置來於自己的現實視野中出現虛擬的物件，其應用價值十分廣泛，尤其在醫療領域正如雨後春筍般地發展。此論文研究使用一個多機擴增實境之平台系統，並應用在聚焦超音波腦部手術以及腹部肝臟穿刺手術，使得手術流程更加簡易且快速，此外更具有展示、教學與模擬的價值。此外，為增加應用的場景之彈性及優化其效果，此論文研究提出相應的方法，最終也設計了一套實驗流程來驗證使用者量測之精準度，並量測該應用時的最大作業距離及幀率。在優化的前置實驗中，我們可以確保執行時幀率在45fps左右，以及製作出在不同應用場景時符合作業距離下且大小適當的錨點；在精準度的實驗方面，若為多用戶皆能看到錨點的情況下，平均誤差為2.7mm，若為錨點被部分遮擋的情況下，平均誤差則為7.16mm，此外也可觀察到使用者距離越遠的情況下平均誤差也會稍微變大，但因皆位於錨點的辨識距離內故誤差也相去不遠。而在不同的應用場景下，也會有相去不遠之結果，故可推出此平台系統對於HoloLens1是非常具有可行性，可以容易地經過適當的修改移植於其他的應用場景中。 | zh_TW |
| dc.description.abstract | Augmented Reality (AR) is a new technology that allows users to visualize virtual objects in their own real field through a headset, and its application value is very wide, especially in the medical field. This thesis research uses a multi-machine augmented reality platform system and is applied to focused ultrasound brain surgery and abdominal liver puncture surgery, making the surgical process easier and faster, and has more value for display, teaching and simulation. In addition, in order to increase the elasticity of the application scenario and optimize its effect, this paper also proposes corresponding methods, and finally designs a set of experimental processes to verify the accuracy of user measurement, and measure the maximum working distance and frame rate of the application. In the optimized pre-experiment, we can ensure that the frame rate is around 45fps when executing, and make anchor points of the appropriate size at the working distance for different application scenarios; In terms of accuracy experiments, if multiple users can see the anchor point, the average error is 2.7mm, if the anchor point is partially occluded, the average error is 7.16mm, and it can also be observed that the farther the user is away, the average error will become slightly larger, but because they are located within the identification distance of the anchor point, the error is not far away. In different application scenarios, there will be results that are not far away, so the launch of this platform system is very feasible for HoloLens 1, and can be appropriately modified and ported to other application scenarios. | en |
| dc.description.provenance | Submitted by admin ntu (admin@lib.ntu.edu.tw) on 2023-06-14T16:16:44Z No. of bitstreams: 0 | en |
| dc.description.provenance | Made available in DSpace on 2023-06-14T16:16:44Z (GMT). No. of bitstreams: 0 | en |
| dc.description.tableofcontents | 致謝 ii
摘要 iii Abstract iv 目錄 v 圖目錄 viii 表目錄 ix 第一章 緒論 1 1.1 擴增實境 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 擴增實境於醫療手術之應用. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.3 聚焦超音波於腦部手術. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.4 腹部肝臟穿刺手術. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 1.5 擴增實境應用於醫療手術之必要性及現有技術難點. . . . . . . . . . . . . . . .11 1.6 研究動機及目的. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 第二章 研究方法與理論 14 2.1 系統架構設計. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 2.1.1 硬體規格. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 2.1.2 軟體系統架構. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 2.2 立體影像重建 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21 2.2.1 閾值切割 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.2.2 分水嶺演算法. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 2.2.3 影像森林轉換. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 2.3 基於 Vuforia 影像辨識之下的錨點製作. . . . . . . . . . . . . . . . . . . . . . . . . . .25 2.4 應用場景之即時性優化 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 2.5 實驗架設與指標. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 第三章 實驗結果及分析 34 3.1 聚焦腦部超音波手術結果. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 3.1.1 聚焦式超音波腦部手術示意圖. . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 3.1.2 辨識距離結果及探討. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 3.1.2.1 錨點型式於辨識結果之影響. . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 3.1.2.2 錨點大小於辨識結果之影響. . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 3.1.3 幀率結果及優化. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 3.1.4 精準度結果及優化. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 3.2 實驗二 每位使用者能看到的錨點情況下及距離不同 . . . . . . . . . . . . . .43 3.3 實驗三 腹部肝臟穿刺手術之應用場景 . . . . . . . . . . . . . . . . . . . . . . . . . .45 第四章 總結及未來展望 49 4.1 結論. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 4.2 未來展望. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 參考文獻 51 附錄 A 實際演示影片 57 | - |
| dc.language.iso | zh_TW | - |
| dc.subject | 聚焦式超音波 | zh_TW |
| dc.subject | 擴增實境 | zh_TW |
| dc.subject | 座標轉換 | zh_TW |
| dc.subject | 多使用者協同 | zh_TW |
| dc.subject | 肝臟穿刺 | zh_TW |
| dc.subject | Augmented Reality | en |
| dc.subject | Liver Biopsy | en |
| dc.subject | Focused ultrasound | en |
| dc.subject | Coordinate Transformation | en |
| dc.subject | Multi-users Synchronization | en |
| dc.title | 多機擴增實境應用平台於臨床術中手術導引 | zh_TW |
| dc.title | Multi-User Augmented Reality Platform for Surgical Interventional Guidance | en |
| dc.type | Thesis | - |
| dc.date.schoolyear | 111-1 | - |
| dc.description.degree | 碩士 | - |
| dc.contributor.oralexamcommittee | 邱錫彥;龍震宇;李正匡 | zh_TW |
| dc.contributor.oralexamcommittee | Shin-Yan Chiou;Chen-Yu Lung;Cheng-Kuang Lee | en |
| dc.subject.keyword | 擴增實境,聚焦式超音波,肝臟穿刺,多使用者協同,座標轉換, | zh_TW |
| dc.subject.keyword | Augmented Reality,Focused ultrasound,Liver Biopsy,Multi-users Synchronization,Coordinate Transformation, | en |
| dc.relation.page | 59 | - |
| dc.identifier.doi | 10.6342/NTU202300466 | - |
| dc.rights.note | 同意授權(限校園內公開) | - |
| dc.date.accepted | 2023-02-17 | - |
| dc.contributor.author-college | 電機資訊學院 | - |
| dc.contributor.author-dept | 電機工程學系 | - |
| dc.date.embargo-lift | 2026-02-13 | - |
| 顯示於系所單位： | 電機工程學系 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-111-1.pdf 授權僅限NTU校內IP使用（校園外請利用VPN校外連線服務） | 3.25 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。