Skip navigation

DSpace

機構典藏 DSpace 系統致力於保存各式數位資料(如:文字、圖片、PDF)並使其易於取用。

點此認識 DSpace
DSpace logo
English
中文
  • 瀏覽論文
    • 校院系所
    • 出版年
    • 作者
    • 標題
    • 關鍵字
    • 指導教授
  • 搜尋 TDR
  • 授權 Q&A
    • 我的頁面
    • 接受 E-mail 通知
    • 編輯個人資料
  1. NTU Theses and Dissertations Repository
  2. 電機資訊學院
  3. 生醫電子與資訊學研究所
請用此 Handle URI 來引用此文件: http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/89568
完整後設資料紀錄
DC 欄位值語言
dc.contributor.advisor張瑞峰zh_TW
dc.contributor.advisorRuey-Feng Changen
dc.contributor.author余銘仁zh_TW
dc.contributor.authorMing-Jen Yuen
dc.date.accessioned2023-09-11T16:17:36Z-
dc.date.available2025-03-01-
dc.date.copyright2023-09-11-
dc.date.issued2023-
dc.date.submitted2023-03-01-
dc.identifier.citationS. De Leo, S. Y. Lee, and L. E. Braverman, "Hyperthyroidism," (in eng), Lancet, vol. 388, no. 10047, pp. 906-918, Aug 27 2016, doi: 10.1016/s0140-6736(16)00278-6.
N. C. Yeh et al., "Hyperthyroidism and thyroid cancer risk: a population-based cohort study," (in eng), Exp Clin Endocrinol Diabetes, vol. 121, no. 7, pp. 402-6, Jul 2013, doi: 10.1055/s-0033-1341474.
Q. T. Nguyen, E. J. Lee, M. G. Huang, Y. I. Park, A. Khullar, and R. A. Plodkowski, "Diagnosis and treatment of patients with thyroid cancer," (in eng), Am Health Drug Benefits, vol. 8, no. 1, pp. 30-40, Feb 2015.
J. Robbins et al., "Thyroid cancer: a lethal endocrine neoplasm," (in eng), Ann Intern Med, vol. 115, no. 2, pp. 133-47, Jul 15 1991, doi: 10.7326/0003-4819-115-2-133.
L. Varadhan, G. I. Varughese, and S. Sankaranarayanan, "Hyperthyroidism and Graves' disease: Is an ultrasound examination needed?," (in eng), Indian J Endocrinol Metab, vol. 20, no. 6, pp. 866-869, Nov-Dec 2016, doi: 10.4103/2230-8210.192899.
K. Salman and E. Sonuç, "Thyroid Disease Classification Using Machine Learning Algorithms," Journal of Physics: Conference Series, vol. 1963, p. 012140, 07/01 2021, doi: 10.1088/1742-6596/1963/1/012140.
L. Ma, C. Ma, Y. Liu, and X. Wang, "Thyroid Diagnosis from SPECT Images Using Convolutional Neural Network with Optimization," (in eng), Comput Intell Neurosci, vol. 2019, p. 6212759, 2019, doi: 10.1155/2019/6212759.
S. W. Kwon, I. J. Choi, J. Y. Kang, W. I. Jang, G. H. Lee, and M. C. Lee, "Ultrasonographic Thyroid Nodule Classification Using a Deep Convolutional Neural Network with Surgical Pathology," (in eng), J Digit Imaging, vol. 33, no. 5, pp. 1202-1208, Oct 2020, doi: 10.1007/s10278-020-00362-w.
K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770-778.
J. Cox, S. Rubin, J. Adams, C. Pereira, M. Dighe, and A. Alessio, Hyperparameter selection for ResNet classification of malignancy from thyroid ultrasound images (SPIE Medical Imaging). SPIE, 2020.
F. Chollet, "Xception: Deep learning with depthwise separable convolutions," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 1251-1258.
X. Zhang, V. C. S. Lee, J. Rong, J. C. Lee, and F. Liu, "Deep convolutional neural networks in thyroid disease detection: A multi-classification comparison by ultrasonography and computed tomography," Computer Methods and Programs in Biomedicine, vol. 220, p. 106823, 2022/06/01/ 2022, doi: https://doi.org/10.1016/j.cmpb.2022.106823.
Z. Liu, H. Mao, C.-Y. Wu, C. Feichtenhofer, T. Darrell, and S. Xie, "A ConvNet for the 2020s," 2022.
Y. Wang and J. Gan, "Benign and Malignant Classification of Thyroid Nodules Based on ConvNeXt," presented at the Proceedings of the 2022 3rd International Conference on Control, Robotics and Intelligent System, Virtual Event, China, 2022.
J. Hu, L. Shen, and G. Sun, "Squeeze-and-Excitation Networks," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7132-7141, 2018.
Z. Gao, J. Xie, Q. Wang, and P. Li, "Global Second-order Pooling Convolutional Networks," November 01, 2018, 2018.
Y. K. Yunpeng Chen, Jianshu Li, Shuicheng Yan, Jiashi Feng, "A2-Nets: Double Attention Networks," presented at the Advances in Neural Information Processing Systems 31 (NeurIPS 2018), 2018.
Z. Gao, J. Xie, Q. Wang, and P. Li, "Global Second-order Pooling Convolutional Networks," p. arXiv:1811.12006. [Online]. Available:https://ui.adsabs.harvard.edu/abs/2018arXiv181112006G.
Q. Wang, B. Wu, P. Zhu, P. Li, W. Zuo, and Q. Hu, "ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks," 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11531-11539, 2020.
S. Liu et al., "Deep Learning in Medical Ultrasound Analysis: A Review," Engineering, vol. 5, no. 2, pp. 261-275, 2019/04/01/ 2019, doi: https://doi.org/10.1016/j.eng.2018.11.020.
J. Wang et al., "Integrating Weighted Feature Fusion and the Spatial Attention Module with Convolutional Neural Networks for Automatic Aircraft Detection from SAR Images," Remote Sensing, vol. 13, no. 5, p. 910, 2021. [Online]. Available: https://www.mdpi.com/2072-4292/13/5/910.
N. Mohanty, M. Pradhan, A. V. N. Reddy, S. Kumar, and A. Alkhayyat, "Integrated Design of Optimized Weighted Deep Feature Fusion Strategies for Skin Lesion Image Classification," (in eng), Cancers (Basel), vol. 14, no. 22, Nov 21 2022, doi: 10.3390/cancers14225716.
Y. Dong, Q. Liu, B. Du, and L. Zhang, "Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification," IEEE Transactions on Image Processing, vol. 31, pp. 1559-1572, 2022, doi: 10.1109/TIP.2022.3144017.
A. Howard et al., "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," 04/16 2017.
L. Perez and J. Wang, "The Effectiveness of Data Augmentation in Image Classification using Deep Learning," p. arXiv:1712.04621.
K. He, R. Girshick, and P. Dollár, "Rethinking ImageNet Pre-training," p. arXiv:1811.08883.
J. A. Hanley and B. J. McNeil, "The meaning and use of the area under a receiver operating characteristic (ROC) curve," Radiology, vol. 143 1, pp. 29-36, 1982.
S. Arlot and A. Celisse, "A survey of cross-validation procedures for model selection," Statistics surveys, vol. 4, pp. 40-79, 2010.
H. Zhang et al., "ResNeSt: Split-Attention Networks," ArXiv, vol. abs/2004.08955, 2020.
W. Wang et al., "Pyramid vision transformer: A versatile backbone for dense prediction without convolutions," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 568-578.
Z. Liu et al., "Swin transformer: Hierarchical vision transformer using shifted windows," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 10012-10022.
H. Touvron, M. Cord, M. Douze, F. Massa, A. Sablayrolles, and H. Jégou, "Training data-efficient image transformers & distillation through attention," in International Conference on Machine Learning, 2021: PMLR, pp. 10347-10357.
J. Yang et al., "Focal Self-attention for Local-Global Interactions in Vision Transformers," ArXiv, vol. abs/2107.00641, 2021.
A. Vaswani et al., "Attention is all you need," Advances in neural information processing systems, vol. 30, 2017.
A. Araujo, W. Norris, and J. Sim, "Computing receptive fields of convolutional neural networks. Distill, 2019," ed, 2019.
F. Yu and V. Koltun, "Multi-scale context aggregation by dilated convolutions," arXiv preprint arXiv:1511.07122, 2015.
S. Liu and D. Huang, "Receptive field block net for accurate and fast object detection," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 385-400.
S. Woo, J. Park, J.-Y. Lee, and I. S. Kweon, "Cbam: Convolutional block attention module," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 3-19.
-
dc.identifier.urihttp://tdr.lib.ntu.edu.tw/jspui/handle/123456789/89568-
dc.description.abstract甲狀腺亢進是一個伴隨嚴重症狀,並有甲狀腺癌潛在高風險的疾病。在早期診斷出甲狀腺亢進,可以減緩甲狀腺癌的病情進展並得以及早治療。甲狀腺超音波具有非侵入性與無放射線攝取的特質,因此常被用於甲狀腺亢進的診斷。然而使用超音波影像進行診斷,非常仰賴放射科醫師的經驗與資質,而可能導致誤診的發生。因此可以使用一個具有自動診斷功能的電腦輔助診斷(computer-aided diagnosis, CADx)系統,來協助放射科醫師進行甲狀腺亢進診斷。
近年來,卷積神經網路(Convolutional Neural Network, CNN)因其在疾病診斷上的優異表現,而被廣泛用於開發電腦輔助診斷上。因此本研究提出了一個基於卷積神經網路的電腦輔助診斷系統,應用於甲狀腺超音波影像並進行甲狀腺亢進診斷。本系統包含了影像預處理與甲狀腺亢進分類。在影像預處理中,會自輸入影像中提取甲狀腺體區域,並調整至固定影像大小。接著,經過預處理的影像會作為所提出的分類模型的輸入,並由模型進行甲狀腺亢進的分類。所提出的分類模型取名為ECA-VCR-ConvNeXt,是修改自ConvNeXt架構而來。為了自原ConvNeXt萃取出包含更多資訊的特徵,加入了高效通道注意力(efficient channel attention, ECA)模塊。此外,為了提升ConvNeXt所萃取特徵的品質,我們提出了向量通道校準(vectorial channel recalibration)模塊並用於實作出加權特徵融合(weighted feature fusion)機制。
在實驗中,我們使用了共851張甲狀腺超音波影像,其中包含了419張甲狀腺亢進影像和432張甲狀腺正能影像,來評估我們診斷系統的表現。根據實驗結果顯示,本研究提出的電腦輔助診斷系統可達到86.37%的正確率、84.49%的靈敏性、88.19%的特異性和0.9046的曲線下面積。實驗結果顯示所提出的系統在甲狀腺亢進的診斷上有非常優秀的能力。
zh_TW
dc.description.abstractHyperthyroidism is a disease with severe symptoms and a potentially high risk of thyroid cancer. An early hyperthyroidism diagnosis can slow the disease progression of thyroid cancer and obtain early treatment. Thyroid ultrasound with non-invasivity and no radiation load is a common approach for hyperthyroidism diagnosis. However, the high dependence on the experience and qualification of radiologists could lead to misdiagnosis. Therefore, a computer-aided diagnosis (CADx) system with automatic diagnosis ability could assist radiologists.
Recently, the convolutional neural network (CNN) has been widely used in developing the CADx system because of its outstanding performance on disease diagnosis. Thus, a CNN-based CADx system was proposed in this study for hyperthyroidism diagnosis on thyroid ultrasound images. The CADx system was composed of image preprocessing and hyperthyroidism classification. In image preprocessing, the thyroid region was extracted from each input image and resized to a fixed resolution. Then, the preprocessed images were fed into the proposed model, ECA-VCR-ConvNeXt, for hyperthyroidism classification. The proposed ECA-VCR-ConvNeXt was modified from a CNN architecture named ConvNeXt. To extract more informative features through the ConvNeXt, the efficient channel attention (ECA) module is embedded. Furthermore, the vectorial channel recalibration (VCR) module was proposed and utilized to introduce the weighted feature fusion to the ConvNeXt for enhanced quality of features.
In experiments, a total of 851 thyroid ultrasound images, including 419 hyperthyroidism images and 432 euthyroidism images, were utilized to evaluate the performance of the proposed system. According to the experiment results, the proposed CADx system could achieve 86.37% accuracy, 84.49% sensitivity, 88.19% specificity, and 0.9046 AUC. These results indicated that the proposed CADx system had an excellent capability in hyperthyroidism diagnosis.
en
dc.description.provenanceSubmitted by admin ntu (admin@lib.ntu.edu.tw) on 2023-09-11T16:17:36Z
No. of bitstreams: 0
en
dc.description.provenanceMade available in DSpace on 2023-09-11T16:17:36Z (GMT). No. of bitstreams: 0en
dc.description.tableofcontents口試委員會審訂書 I
致謝 II
摘要 III
Abstract V
Table of Contents VII
List of Figures IX
List of Tables XI
Chapter 1 Introduction 1
Chapter 2 Materials 5
Chapter 3 Methods 8
3.1. Image Preprocessing 10
3.2. Hyperthyroidism Classification 11
3.2.1. ConvNeXt 13
3.2.2. ECA-VCR-ConvNeXt Block 15
3.2.2.1. Efficient Channel Attention (ECA) 17
3.2.2.2. Vectorial Channel Recalibration (VCR) 19
3.3. Model Training 20
Chapter 4 Experiment Results and Discussion 22
4.1. Experiment Environment 22
4.2. Evaluation 22
4.3. Experiment Results 22
4.3.1. Ablation Study 23
4.3.2. Comparison of Different Architectures 27
4.3.3. Comparison of Different Cropping Methods 29
4.4. Discussion 33
Chapter 5 Conclusion 39
Reference 41
-
dc.language.isoen-
dc.subject通道注意力機制zh_TW
dc.subject甲狀腺亢進zh_TW
dc.subject超音波zh_TW
dc.subject電腦輔助診斷系統zh_TW
dc.subject卷積神經網路zh_TW
dc.subject加權特徵融合zh_TW
dc.subjectUltrasounden
dc.subjectConvolution neural network (CNN)en
dc.subjectComputer-aided diagnosis (CADx)en
dc.subjectHyperthyroidismen
dc.subjectweighted feature fusionen
dc.subjectchannel-wise attentionen
dc.title應用通道注意力機制和加權特徵融合之ConvNeXt網路於甲狀腺超音波影像亢進診斷zh_TW
dc.titleA ConvNeXt-based Network with Channel Attention Mechanism and Weighted Feature Fusion for Hyperthyroidism Diagnosis in Thyroid Ultrasound Imageen
dc.typeThesis-
dc.date.schoolyear111-2-
dc.description.degree碩士-
dc.contributor.oralexamcommittee羅崇銘;陳啟禎zh_TW
dc.contributor.oralexamcommitteeChung-Ming Lo;Chii-Jen Chenen
dc.subject.keyword甲狀腺亢進,超音波,電腦輔助診斷系統,卷積神經網路,通道注意力機制,加權特徵融合,zh_TW
dc.subject.keywordHyperthyroidism,Ultrasound,Computer-aided diagnosis (CADx),Convolution neural network (CNN),channel-wise attention,weighted feature fusion,en
dc.relation.page44-
dc.identifier.doi10.6342/NTU202300649-
dc.rights.note未授權-
dc.date.accepted2023-03-01-
dc.contributor.author-college電機資訊學院-
dc.contributor.author-dept生醫電子與資訊學研究所-
顯示於系所單位:生醫電子與資訊學研究所

文件中的檔案:
檔案 大小格式 
ntu-111-2.pdf
  未授權公開取用
945.52 kBAdobe PDF
顯示文件簡單紀錄


系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。

社群連結
聯絡資訊
10617臺北市大安區羅斯福路四段1號
No.1 Sec.4, Roosevelt Rd., Taipei, Taiwan, R.O.C. 106
Tel: (02)33662353
Email: ntuetds@ntu.edu.tw
意見箱
相關連結
館藏目錄
國內圖書館整合查詢 MetaCat
臺大學術典藏 NTU Scholars
臺大圖書館數位典藏館
本站聲明
© NTU Library All Rights Reserved