請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/35199
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 陳正剛(Argon Chen) | |
dc.contributor.author | Hsuan-Hsien Chou | en |
dc.contributor.author | 周軒賢 | zh_TW |
dc.date.accessioned | 2021-06-13T06:43:49Z | - |
dc.date.available | 2005-08-01 | |
dc.date.copyright | 2005-08-01 | |
dc.date.issued | 2005 | |
dc.date.submitted | 2005-07-29 | |
dc.identifier.citation | [1] Fisher, R. A., “The use of multiple measurements in taxonomic problems,” Annals of Eugenics 7, 179-188, 1936.
[2] R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York: Wiley-Interscience, 2001. [3] Mika, S., Rätsch, G.., Weston, J., Schölkopf, B., & Müller, K-R., “Fisher discriminant analysis with kernels,” IEEE International Workshop on Neural Networks for Signal Processing, Vol. IX, Madison, USA, August 1999, 41-48. [4] Malte Kuss, “Nonlinear multivariate analysis with geodesic kernels,” Technische Universität Berlin, Diplomarbeit, Februar 2002. [5] B. Schölkopf, A. Smola, and K.-R. Müller, “Nonlinear component analysis as a kernel eigenvalue problem,” Neural Computation, vol. 10, pp. 1299-1319, 1998. [6] Jianguo Zhang and Kai-Kuang Ma, “Kernel fisher discriminant for texture classification,” School of Electrical and Electronic Engineering, Nanyang Technological University, September 2004. [7] Qingshan Liu, Hanqing Lu, and Songde Ma, “Improving kernel fisher discriminant analysis for face recognition,” IEEE Transactions on Circuits and Systems for Video Technology, vol.14, No.1, January 2004 [8] S. Z. Li and J. W. Lu, “Face recognition using the nearest feature line method,” IEEE Trans. Neural Networks, vol. 10, pp. 439–443, 1999. [9] E. Fix and J. L. Hodges, Jr., “Discriminatory Analysis — Nonparametric Discrimination: Consistency Properties,” Project 21–49–004, Report No. 4, USAF School of Aviation Medicine, Randolf Field, TX, 1951, pp. 261–279. [10] V. Vapnik, The nature of statistical learning theory, New York: Springer Verlag, 1995 [11] B. Schölkopf, A. Smola, & K-R Müller, “Kernel principal component analysis,” In B. Schölkopf, C.J.C. Burges, & A. J. Smola, editors, Advanced in Kernel Methods – Support Vector Machine. 327-352. MIT Press, Cambridge, MA, 1999. [12] S. Saitoh, Theory of Reproducing Kernels and its Applications, Longman Scientific & Technical, Harlow, England, 1988. [13] Chih-Wei Hsu, Chih-Chung Chang and Chih-Jen Lin, “A practical guide to support vector classification,” available at http://www.csie.ntu.edu.tw/~cjlin/papaers/guide/guide.pdf [14] Chih-Chung Chang and Chih-Jen Lin. LIBSVM: A Library for Support Vector Machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm [15] Armstrong S, Staunton JE, Silverman LB, et al, “MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia,” Nature Genet, 2002, 30: 41-47. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/35199 | - |
dc.description.abstract | 費雪線性區別(Fisher’s linear discriminant)分析是一個可有效進行資料特徵攫取(feature extraction)的方法,其目的在於找到某個方向,使得訓練資料(training instances)於其上的線性投影點—稱之為「區別得點(discriminant score)」—可展現各群體間最大的區別性。核心費雪區別(kernel Fisher discriminant)分析則將訓練資料傳送到一個更高維度的空間,並於該空間中執行費雪線性區別分析,此種非線性的方法可藉由將費雪線性區別的求解問題完全以內積的形式表示並運用核技巧(kernel trick)來使之成為可行。
以區別得點為基礎,我們可使用各種分類方法(classifier)來對驗證資料(testing instances)進行分類。最近中心點分類法(nearest center classifier)通常會與費雪線性區別與核心費雪區別結合使用,但是當區別得點的分佈產生重心偏移的現象時,無論是歐氏(Euclidean)或馬氏(Mahalanobis)距離的使用都將導致不理想的分類效能。我們提出兩種分類方法來改善此種情形下的分類結果。這兩種方法皆只使用部份的訓練資料來計算共變異矩陣,其中一種方法的資料選取方式是以驗證和訓練資料所定義的夾角為基礎,而另一種方法下的資料選取則是根據兩兩群體中心所決定的超平面(hyperplanes)。這些分類法的優點在於去除了不適當的訓練資料,使得我們可避免不確實的共變異數矩陣的估計。 另一個我們欲探討的議題為某分類方法對環境變化的敏感度(sensitivity),而我們所考慮的變化包含了參數數值、訓練資料群(training dataset)大小以及訓練資料群抽樣結果的改變,此外,我們也將討論綜合性的敏感度,即一個分類方法對某種環境變化的敏感度將如何被其他類型的環境變化所影響。 最後,我們在案例學習中透過兩筆實際資料來驗證所提出的方法。根據這些資料,我們對多種分類方法的效能進行比較,並對其執行敏感性分析。分析的結果指出,我們提出的方法其效能等同—甚至優於—其他以核心費雪區別為基礎的分類方法,同時我們也發現在提出的方法中,有一個方法對於不同的環境變化會較其他分類方法來得更為敏感。 | zh_TW |
dc.description.abstract | Fisher’s Linear Discriminant (FLD) analysis is an efficient method for feature extraction. The objective of that is to find the direction on which the linear projection of training instances, called “discriminant scores”, can provide the maximal separability of classes. Kernel Fisher Discriminant (KFD) analysis will map training instances into a higher dimensional space and perform FLD analysis there. Such a nonlinear approach can be feasible by reformulating the FLD problem in terms of only inner products and applying the kernel trick to that.
Based on the discriminant scores, we can use various classifiers to classify testing instances. The nearest center classifier is usually combined with FLD and KFD. But when the score distribution is skewed, no matter the use of Euclidean or Mahalanobis distance, it will lead to weak classification performance. We propose two classifiers to enhance the classification result in such a situation. Both of them use a proportion of training instances for covariance matrix computation. The instance selection of one method is based on the included angle defined by testing and training instances; that of the other method is according to the hyperplanes determined by paired-class centers. The advantage of these classifiers is that we can avoid a loose estimate of the covariance matrix by excluding the training instances deemed irrelevant. Another issue we attempt to address in is how sensitive a classifier is to environment changes. These environment changes that we consider include changes of parameter value, changes of training dataset size, and changes of training dataset sampling. We also discuss the combined sensitivity, i.e., how a classifier’s sensitivity to one type of environment change is affected by other types of environment changes. Finally, we demonstrate our proposed methods through two real-world datasets in the case study. We compare the performance of various classifiers based on these datasets and perform sensitivity analysis to them. The results indicate that the performance of the proposed methods is equivalent, even superior, to that of other KFD-based classifiers. We also find that one of our methods is more sensitive to different environment changes than other classifiers. | en |
dc.description.provenance | Made available in DSpace on 2021-06-13T06:43:49Z (GMT). No. of bitstreams: 1 ntu-94-R92546001-1.pdf: 1445742 bytes, checksum: 60a71e39b4d91ff80add13816282c38c (MD5) Previous issue date: 2005 | en |
dc.description.tableofcontents | Abstract i
論文摘要 ii Contents iii Contents of Figures v Contents of Tables vii Chapter 1 Introduction 1 1.1 Background 1 1.2 Classification based on Euclidean Distance 4 1.3 Problem Description and Research Objective 5 1.4 Thesis Organization 8 Chapter 2 KFD Classification Using Mahalanobis Distance 10 2.1 Review of KFD and KFD Classification 10 2.1.1 Kernel Fisher Discriminant 10 2.1.2 Classification Tools 15 2.1.3 Problem of Euclidean Distance in the NC classifier 17 2.2 KFD Classification Using Adjusted Mahalanobis Distance 21 2.2.1 Mahalanobis NC Classifier with Cone Reference Region 21 2.2.2 Mahalanobis NC Classifier with One-Against-One Reference Region 27 Chapter 3 Performance Sensitivity Analysis 30 3.1 Sensitivity to Parameters 32 3.2 Sensitivity to Training Dataset Size 35 3.3 Sensitivity to Training Dataset Sampling 37 3.4 Combined Sensitivity 38 3.4.1 Parameters and Training Dataset Size 38 3.4.2 Training Dataset Size and Training Dataset Sampling 39 Chapter 4 Case Study 41 4.1 Balance Dataset 41 4.2 MLL Leukemia Microarray Dataset 49 Chapter 5 Conclusions and Future Research 58 References 59 Appendix A. Matlab Code – kernel function 61 Appendix B. Matlab Code – classifiers 62 Appendix C. Selected Genes 68 | |
dc.language.iso | en | |
dc.title | KFD分析的分類方法與評估研究 | zh_TW |
dc.title | Classification Methods and Their Evaluation for Kernel Fisher Discriminant Analysis | en |
dc.type | Thesis | |
dc.date.schoolyear | 93-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 林智仁(Chih-Jen Lin),宗福季,范治民,仲偉強 | |
dc.subject.keyword | 核心費雪區別,最近中心點分類法,馬氏距離,敏感度分析, | zh_TW |
dc.subject.keyword | kernel Fisher discriminant,nearest center classifier,Mahalanobis distance,sensitivity analysis, | en |
dc.relation.page | 69 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2005-07-29 | |
dc.contributor.author-college | 工學院 | zh_TW |
dc.contributor.author-dept | 工業工程學研究所 | zh_TW |
顯示於系所單位: | 工業工程學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-94-1.pdf 目前未授權公開取用 | 1.41 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。