請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/70204
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 王偉仲(Wei-Chung Wang) | |
dc.contributor.author | Wan-Yun Yang | en |
dc.contributor.author | 楊宛芸 | zh_TW |
dc.date.accessioned | 2021-06-17T03:49:14Z | - |
dc.date.available | 2020-09-02 | |
dc.date.copyright | 2020-09-02 | |
dc.date.issued | 2020 | |
dc.date.submitted | 2020-08-18 | |
dc.identifier.citation | [1] Z. Li and D. Hoiem. Learning without forgetting.IEEE transactions on patternanalysis and machine intelligence, 40(12):2935–2947, 2017. [2] G. Litjens, T. Kooi, B. E. Bejnordi, A. A. A. Setio, F. Ciompi, M. Ghafoorian,J. A. Van Der Laak, B. Van Ginneken, and C. I. S ́anchez. A survey on deeplearning in medical image analysis.Medical image analysis, 42:60–88, 2017. [3] K.-L. Liu, T. Wu, P.-T. Chen, Y. M. Tsai, H. Roth, M.-S. Wu, W.-C. Liao,and W. Wang. Deep learning to distinguish pancreatic cancer tissue from non-cancerous pancreatic tissue: a retrospective study with cross-racial external val-idation.The Lancet Digital Health, 2(6):e303–e313, 2020. [4] S. J. Pan and Q. Yang. A survey on transfer learning.IEEE Transactions on knowledge and data engineering, 22(10):1345–1359, 2009. [5] H. R. Roth. Cancer imaging archive wiki. [6] H. R. Roth, A. Farag, L. Lu, E. B. Turkbey, and R. M. Summers. Deep convo-lutional networks for pancreas segmentation in CT imaging. In Medical Imaging2015: Image Processing, volume 9413, page 94131G. International Society for Optics and Photonics, Mar. 2015. [7] R. L. Siegel, K. D. Miller, and A. Jemal. Cancer statistics, 2019.CA: a cancerjournal for clinicians, 69(1):7–34, 2019.40 [8] A. L. Simpson, M. Antonelli, S. Bakas, M. Bilello, K. Farahani, B. Van Ginneken,A. Kopp-Schneider, B. A. Landman, G. Litjens, B. Menze, et al. A large anno-tated medical image dataset for the development and evaluation of segmentationalgorithms.arXiv preprint arXiv:1902.09063, 2019. [9] Z. Zhou, J. Shin, L. Zhang, S. Gurudu, M. Gotway, and J. Liang. Fine-tuningconvolutional neural networks for biomedical image analysis: actively and incre-mentally. InProceedings of the IEEE conference on computer vision and patternrecognition, pages 7340–7351, 2017. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/70204 | - |
dc.description.abstract | 胰腺癌是消化系統中第二常見的癌症,人工智能通常用於協助醫生進行腫瘤檢測。由於包括胰腺在內的所有醫學圖像都是珍貴且難以獲得的,因此我嘗試對圖像進行轉移學習以提高外部數據集的性能。在醫生的幫助下,我獲得了足夠的數據來訓練準確的卷積神經網絡作為基礎分類模型。在此模型的基礎下,我需要將模型使用於不同的數據集,但是在其他數據集上進行測試時,分類模型的性能會降低。我的目標是使用遷移學習方法基於基礎分類模型創造能在外部數據集有精確結果的模型。在本文中,我們試圖在醫學圖像分析的背景下回答以下核心問題:微調,一種常見的遷移學習方法,如何提高外部數據集的性能;為了獲得一定的性能,我們需要多少數據。我們的實驗一致表明,隨著我們獲得越來越多的外部數據,我們可以獲得對於外部數據更好的預測結果。本文可以幫助評估獲得滿意預測表現所需的外部資料量,並在全球範圍內推廣先前開發的神經網絡模型。此外,還使用增量學習來評估哪個外部掃描圖像(無手動標記)最能改善性能,以便我們可以選擇有價值的數據進行標記。在本文中,我發現混合數據方法和微調方法可以顯著提高外部數據的模型性能。以微調方法為基礎的增量選擇方法可以稍微改善模型性能,但總體而言,它的性能並不比基本的微調更好。 | zh_TW |
dc.description.abstract | Pancreatic cancer is the second most frequent cancer of the digestive system, and artificial intelligence is frequently applied to help doctors with tumor detection. Since all medical images, including pancreas CT, are precious and hard to get, I tried transfer learning on images to improve performance on external dataset. With the help of doctors, I get enough data to train an accurate convolution neural network as source model. In the future, I will apply model to different datasets, but the AUC performance of classification model decreases when testingon other datasets. My goal is to enhance the performance of model on other datasetusing transfer learning methods.In this paper, we seek to answer the following core question in the context of med-ical image analysis: how fine-tuning improves the performance on external dataset;how much data we need to get a certain performance. Our experiments consistently demonstrated that, as we get more and more external data, we can get a betterprediction result on external data. This paper can help to evaluate how many exter-nal data we need to get a satisfying result and help to promote the previous neuralnetwork model worldwide. Also, incremental learning was used to evaluate which external scan image (without a manual label) improved the performance most so that we can choose valuable data to label. In this thesis, I found that mixed data method and fine-tuning method can obviously enhance the model performance on external data. The selection method incremental provided can slightly improve the model performance, but overall it doesn’t perform better than basic fine-tuning. | en |
dc.description.provenance | Made available in DSpace on 2021-06-17T03:49:14Z (GMT). No. of bitstreams: 1 U0001-1708202017375100.pdf: 2706931 bytes, checksum: 0d0c652b9ce51144e068c77418889804 (MD5) Previous issue date: 2020 | en |
dc.description.tableofcontents | Contents 口試委員會審定書 i 誌謝 ii 摘要 iii Abstract iv 1 Introduction1 1.1 Background 1 1.1.1 Technical background 1 1.1.2 Clinical background 1 1.1.3 Transfer Learning and Fine-Tuning 2 1.1.4 incremental Learning 2 1.1.5 Research Team Background 2 1.2 Study objectives 3 2 Methods 4 2.1 Previous Experiment and Results 4 2.2 Study Design 4 2.2.1 Study Goal 4 2.3 Data 5 2.3.1 Data Source 5 2.3.2 Data Criteria 5 2.3.3 Data Format 7 2.3.4 Data Partitions 7 2.4 Model 8 2.5 Training 9 3 Experiments10 3.1 Cross Validation 10 3.2 Basic Models 11 3.2.1 Train Models Using Only Source Data (B1) 12 3.2.2 Train Models Using Only Target Data (B2) 12 3.2.3 Choose the Number of Fixed Layer in Fine-tuning Experiments (B3) 12 3.3 Mixed Data Models 12 3.3.1 Mixed Data Models (M1) 12 3.4 Fine-Tuning Models 13 3.4.1 Fine-Tuning Models (M2) 13 3.5 Increment Fine-Tuning Models 13 3.5.1 AIFT Selection Method 13 3.5.2 Fine-tuning Using Selected/Random Target Data (S1/R1) 14 3.5.3 Fine-tuning Using Different Amount of Target data (S2/R2) 14 3.5.4 Fine-tuning Using Selected/Random Target Data with 66 epochs(S3/R3) 14 4 Result 15 4.1 Basic Models 15 4.1.1 Train Models Using Only Source Data (B1) 15 4.1.2 Train Models Using Only Target Data (B2) 16 4.1.3 Choose the Number of Fixed Layers in Fine-tuning Experiments (B3) 18 4.2 Mixed Data Models 19 4.2.1 Mixed Data Models (M1) 19 4.3 Fine-Tuning Models 21 4.3.1 Fine-Tuning Models (F1) 21 4.4 Incremental Fine-Tuning Models 22 4.4.1 Fine-tuning Using Selected/Random Target Data (S1/R1) 22 4.4.2 Number of Target Data in each Selection Step (S2/R2) 25 4.4.3 Reduce the Epochs to Compare With Fine-tuning Experiments (S3/R3) 27 4.5 The AUC Performance of mixed Data Experiments 30 4.6 The AUC Performance of Fine-Tuning Experiments 31 4.7 Comparison of Mixed Data Experiments and Fine-Tuning Experiments 33 4.8 Validation of Selection Method in incremental Learning 34 4.9 Comparison of Fine-Tuning Experiments and Incremental Learning Experiments 36 5 Discussion 38 5.0.1 The Performance of Each Methods 38 5.0.2 Incremental Learning 38 5.1 Limitations 38 5.2 Future Work 39 Bibliography 41 | |
dc.language.iso | en | |
dc.title | 遷移學習應用於二維胰臟影像小區塊方式之腫瘤辨識 | zh_TW |
dc.title | Applying Transfer Learning on 2D Patch-Based Healthy Pancreas and Pancreatic Tumor Classification | en |
dc.type | Thesis | |
dc.date.schoolyear | 108-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 陳素雲(Su-Yun Chen),廖偉智(Wei-Zhi Liao) | |
dc.subject.keyword | 醫療影像,人工智慧,類神經網路,深度學習,遷移學習, | zh_TW |
dc.subject.keyword | Medical Images,Artificial Intelligence,Neural Network,Deep Learning,Transfer Learning, | en |
dc.relation.page | 41 | |
dc.identifier.doi | 10.6342/NTU202003826 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2020-08-19 | |
dc.contributor.author-college | 理學院 | zh_TW |
dc.contributor.author-dept | 應用數學科學研究所 | zh_TW |
顯示於系所單位: | 應用數學科學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
U0001-1708202017375100.pdf 目前未授權公開取用 | 2.64 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。