請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/55637
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 孫雅麗 | |
dc.contributor.author | Ya-Min Tseng | en |
dc.contributor.author | 曾雅敏 | zh_TW |
dc.date.accessioned | 2021-06-16T04:14:10Z | - |
dc.date.available | 2019-09-03 | |
dc.date.copyright | 2014-09-03 | |
dc.date.issued | 2014 | |
dc.date.submitted | 2014-08-20 | |
dc.identifier.citation | [1] Agarwal, M., Shah, R., & Mannem, P. (2011). Automatic question generation using discourse cues. In Proceedings of the 6th Workshop on Innovative Use of NLP for Building Educational Applications, 1-9.
[2] Ali, H., Chali, Y., & Hasan, S. A. (2010). Automatic Question Generation from Sentences. In Proceedings of QG2010: The Third Workshop on Question Generation. [3] Allessi, S. M., Anderson, R. C., Anderson, T. H., Biddle, W. B., & Dalgaard, B. R. (1974). Development and Implementation of the Computer Assisted Instruction Study Management System (CAISMS): DTIC Document. [4] Anderson, R. C., & Biddle, W. B. (1975). On asking people questions about what they are reading. Psychology of learning and motivation, 9, 89-132. [5] Bannard, C., & Callison-Burch, C. (2005). Paraphrasing with bilingual parallel corpora. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, 597-604. [6] Barzilay, R., & Lee, L. (2003). Learning to paraphrase: An unsupervised approach using multiple-sequence alignment. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology-Volume 1, 16-23. [7] Barzilay, R., & McKeown, K. R. (2001). Extracting paraphrases from a parallel corpus. In Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, 50-57. [8] Bernhard, D., De Viron, L., Moriceau, V., & Tannier, X. (2012). Question Generation for French: Collating Parsers and Paraphrasing Questions. Dialogue & Discourse, 3(2), 43-74. [9] Bhagat, R., & Hovy, E. (2013). What is a paraphrase? Computational Linguistics. [10] Brown, J. C., Frishkoff, G. A., & Eskenazi, M. (2005). Automatic question generation for vocabulary assessment. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, 819-826. [11] Callison-Burch, C., & Dredze, M. (2010). Creating speech and language data with Amazon's Mechanical Turk. In Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, 1-12. [12] Chen, C.-Y., Liou, H.-C., & Chang, J. S. (2006). Fast: an automatic generation system for grammar tests. In Proceedings of the COLING/ACL on Interactive presentation sessions, 1-4. [13] Chen, W., Aist, G., & Mostow, J. (2009). Generating Questions Automatically from Informational Text. In Proceedings of the 2nd Workshop on Question Generation (AIED 2009), 17-24. [14] Curto, S., Mendes, A. C., & Coheur, L. (2011). Exploring linguistically-rich patterns for question generation. In Proceedings of the UCNLG+ eval: Language Generation and Evaluation Workshop, 33-38. [15] Dolan, B., Quirk, C., & Brockett, C. (2004). Unsupervised construction of large paraphrase corpora: Exploiting massively parallel news sources. In Proceedings of the 20th international conference on Computational Linguistics, 350. [16] Ganitkevitch, J., Van Durme, B., & Callison-Burch, C. (2013). Ppdb: The paraphrase database. In Proceedings of NAACL-HLT, 758-764. [17] Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and validating test items: Routledge. [18] Hasan, Y. C. S. A. (2012). Towards Automatic Topical Question Generation. In Proceedings of COLING 2012: Technical Paper, 475-492. [19] Heilman, M. (2011). Automatic factual question generation from text. Carnegie Mellon University. [20] Heilman, M., & Smith, N. A. (2009). Question generation via overgenerating transformations and ranking: DTIC Document. [21] Heilman, M., & Smith, N. A. (2010a). Extracting simplified statements for factual question generation. In Proceedings of QG2010: The Third Workshop on Ques-tion Generation, 11-20. [22] Heilman, M., & Smith, N. A. (2010b). Good question! statistical ranking for question generation. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, 609-617. [23] Heilman, M., & Smith, N. A. (2010c). Rating computer-generated questions with Mechanical Turk. In Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, 35-40. [24] Hoshino, A., & Nakagawa, H. (2007). Assisting cloze test making with a web application. In Society for Information Technology & Teacher Education International Conference, 2807-2814. [25] Ibrahim, A., Katz, B., & Lin, J. (2003). Extracting structural paraphrases from aligned monolingual corpora. In Proceedings of the second international workshop on Paraphrasing-Volume 16, 57-64. [26] Kolb, P. (2008). DISCO: A multilingual database of distributionally similar words. In Proceedings of KONVENS. [27] Lee, J., & Seneff, S. (2007). Automatic generation of cloze items for prepositions. In INTERSPEECH, 2173-2176. [28] Levy, R., & Andrew, G. (2006). Tregex and Tsurgeon: tools for querying and manipulating tree data structures. In Proceedings of the fifth international conference on Language Resources and Evaluation, 2231-2234. [29] Lin, D., & Pantel, P. (2001). DIRT@ SBT@ discovery of inference rules from text. In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, 323-328. [30] Lin, Y.-C., Sung, L.-C., & Chen, M. C. (2007). An automatic multiple-choice question generation scheme for english adjective understanding. In Workshop on Modeling, Management and Generation of Problems/Questions in eLearning, the 15th International Conference on Computers in Education (ICCE 2007), 137-142. [31] Lin, Z., Ng, H. T., & Kan, M.-Y. (2010). A PDTB-styled end-to-end discourse parser: Cambridge Univ Press. [32] Liu, M., Calvo, R., Aditomo, A., & Pizzato, L. (2012). Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support. IEEE Transactions on Learning Technologies, 5(3), 251-263. [33] Mannem, P., Prasad, R., & Joshi, A. (2010). Question generation from paragraphs at UPenn: QGSTEC system description. In Proceedings of QG2010: The Third Workshop on Question Generation, 84-91. [34] Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S. J., & McClosky, D. (2014). The Stanford CoreNLP Natural Language Processing Toolkit. In In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 55-60. [35] Melamud, O., Berant, J., Dagan, I., Goldberger, J., & Szpektor, I. (2014). A Two Level Model for Context Sensitive Inference Rules. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 1331-1340. [36] Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990). Introduction to wordnet: An on-line lexical database*. International journal of lexicography, 3(4), 235-244. [37] Mitkov, R., & Ha, L. A. (2003). Computer-aided generation of multiple-choice tests. In Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing-Volume 2, 17-22. [38] Mostow, J., & Chen, W. (2009). Generating Instruction Automatically for the Reading Strategy of Self-Questioning. In AIED, 465-472. [39] Mostow, J., & Jang, H. (2012). Generating diagnostic multiple choice comprehension cloze questions. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP, 136-146. [40] Olney, A. M., Graesser, A. C., & Person, N. K. (2012). Question generation from concept maps. Dialogue & Discourse, 3(2), 75-99. [41] Papasalouros, A., Kanaris, K., & Kotis, K. (2008). Automatic Generation Of Multiple Choice Questions From Domain Ontologies. In e-Learning, 427-434. [42] Paşca, M., & Dienes, P. (2005). Aligning needles in a haystack: Paraphrase acquisition across the web Natural Language Processing–IJCNLP 2005 (pp. 119-130): Springer. [43] Pino, J., Heilman, M., & Eskenazi, M. (2008). A selection strategy to improve cloze question quality. In Proceedings of the Workshop on Intelligent Tutoring Systems for Ill-Defined Domains. 9th International Conference on Intelligent Tutoring Systems, Montreal, Canada, 22-32. [44] Popowich, D. L. F., & Winne, J. N. P. (2013). Generating Natural Language Questions to Support Learning On-Line. In Proceedings of the 14th European Workshop on Natural Language Generation. [45] Pradhan, S. S., Ward, W., Hacioglu, K., Martin, J. H., & Jurafsky, D. (2004). Shallow Semantic Parsing using Support Vector Machines. In HLT-NAACL, 233-240. [46] Prasad, R., Dinesh, N., Lee, A., Miltsakaki, E., Robaldo, L., Joshi, A. K., & Webber, B. L. (2008). The Penn Discourse TreeBank 2.0. In LREC. [47] Prasad, R., & Joshi, A. (2008). A Discourse-based Approach to Generating Why-Questions from Texts. In Proceedings of the Workshop on the Question Generation Shared Task and Evaluation Challenge. [48] Recasens, M., & Vila, M. (2010). On paraphrase and coreference. Computational Linguistics, 36(4), 639-647. [49] Rokhlenko, O., & Szpektor, I. (2013). Generating Synthetic Comparable Questions for News Articles. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 742-751. [50] Sharpe, P. J. (2010). Barron's TOEFL IBT: Internet-based Test (Vol. 1): Barron's educational series. [51] Shinyama, Y., Sekine, S., & Sudo, K. (2002). Automatic paraphrase acquisition from news articles. In Proceedings of the second international conference on Human Language Technology Research, 313-318. [52] Smith, A. K. S., Avinesh, P., & Kilgarriff, A. (2010). Gap-fill Tests for Language Learners: Corpus-Driven Item Generation. In Proceedings of ICON-2010: 8th International Conference on Natural Language Processing. [53] Sumita, E., Sugaya, F., & Yamamoto, S. (2005). Measuring non-native speakers' proficiency of English by using a test with automatically-generated fill-in-the-blank questions. In Proceedings of the second workshop on Building Educational Applications Using NLP, 61-68. [54] Wolfe, J. H. (1976). Automatic question generation from text-an aid to independent study. In ACM SIGCUE Outlook, 104-112. [55] Wyse, B., & Piwek, P. (2009). Generating questions from openlearn study units. In Proceedings of the Second Workshop on Question Generation. [56] Yang, Y.-C., Yang, J.-F., Chang, J.-M., & Chang, J. S. (2006). Development of a Computer Assisted Reading Comprehension Test. In International Conference on English Instruction and Assessment [57] Yao, X. (2011). Generating More Specific Questions. In 2011 AAAI Fall Symposium Series. [58] Yao, X., Bouma, G., & Zhang, Y. (2012). Semantics-based Question Generation and Implementation. Dialogue & Discourse, 3(2), 11-42. [59] Yao, X., & Zhang, Y. (2010). Question generation with minimal recursion semantics. In Proceedings of QG2010: The Third Workshop on Ques-tion Generation, 68. [60] Zhao, S., Lan, X., Liu, T., & Li, S. (2009). Application-driven statistical paraphrase generation. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2, 834-842. [61] Zhao, S., Niu, C., Zhou, M., Liu, T., & Li, S. (2008). Combining Multiple Resources to Improve SMT-based Paraphrasing Model. In Proceedings of ACL/HLT. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/55637 | - |
dc.description.abstract | 隨著線上英語學習環境的普及,以英語為外語(English as a Foreign Language)學習者擁有更多學習的管道,這些自主學習者需要借助自動評量(automatic assessment)工具以評估閱讀理解與學習成效。然而,現有自動出題系統(automatic question generation system)僅注重將直述句轉換為問句的過程,用字遣詞與原始文字完全相同,即使沒有正確理解篇章,也能透過搜尋文章中相同字段來判斷答案。對此,我們提出將自動改寫(paraphrase generation)結合自動出題以產生閱讀理解選項敘述。我們的系統包含三個部份,在Choice Generation System中,我們的轉換規則設計得以確保所有自動產生的選項背後都有特定的測驗目標,此外,語句關係(discourse relation)辨識和自動改寫概念的引入,可使選項更加多樣; Paraphrase Generation System透過詞彙、句構和指代的自動改寫加大選項的字面差異,並使用自動出題特有的改寫資源-名詞指代(nominal coreference),將篇章的指代關係融入改寫當中; Acceptability Ranker 使用與自動改寫領域和自動出題領域相關的特徵(feature)進行訓練,並以選項接受度為基準排序改寫選項。在最終評估中,我們的系統所產生的選項雖然在文法性、合理性和整體品質上些微地低於標竿系統,但是我們擁有較高的選項難度,並且在比較選項與來源文字的同異時,未更動的比例明顯低於標竿系統。 | zh_TW |
dc.description.abstract | As online English learning environment becomes more and more ubiquitous, English as a Foreign Language (EFL) learners have more choices to learning English. There is thus an increasing demand for automatic assessment tools that help self-motivated learners evaluate their understanding and comprehension. Existing question generation systems, however, focus on the sentence-to-question surface transformation and the questions could be simply answered by word matching, even without good comprehension. We propose a novel approach to generating multiple-choice reading comprehension questions by combining paraphrase generation with question generation. To achieve this, we build a system that consists of three components. In the Choice Generation System, transformation rules are designed to ensure that every generated statement is bound up with a specific testing purpose. Discourse relation recognition and the concept of paraphrasing are also introduced into the system, enriching the choice candidates. The Paraphrase Generation System then moves on to enlarge the superficial difference by paraphrasing lexically, syntactically and referentially. We adopt QG-specific paraphrase resource, nominal coreference, into the system to capture article-wide coreferential relations. Finally, the Acceptability Ranker is trained based on useful features that have been seen in paraphrase generation and question generation to rank paraphrases by their acceptability as question choices. In the final evaluation, although there is a slight decrease in the scores of grammaticality, make-sense and overall quality, our results outperform the baseline system in the challenging score and have a significantly smaller percentage of statements that are identical to the sources sentences. | en |
dc.description.provenance | Made available in DSpace on 2021-06-16T04:14:10Z (GMT). No. of bitstreams: 1 ntu-103-R01725009-1.pdf: 1851925 bytes, checksum: b768a6aa10e9fbafbbc73edd520a95d3 (MD5) Previous issue date: 2014 | en |
dc.description.tableofcontents | 謝辭 i
論文摘要 ii THESIS ABSTRACT iii List of Figures vii List of Tables viii Chapter 1 Introduction 1 1.1 Question Generation 1 1.2 Research Problems 2 1.3 Assumptions 6 1.4 Research Questions 7 1.5 Outline 9 Chapter 2 Related Work 10 2.1 Question Generation 10 2.1.1 Reading Comprehension Question Generation 11 2.1.2 Distractors and Testing Purposes 11 2.2 Discourse Relation 14 2.3 Paraphrasing 16 2.3.1 Research on Paraphrasing 16 2.3.2 Paraphrasing in Question Generation 18 Chapter 3 System Overview 20 3.1 Motivation 20 3.2 Task Definition 22 3.3 Conventions and Definitions 23 3.4 Testing Purposes 24 3.5 System Architecture 25 Chapter 4 Approach 29 4.1 Choice Generation System 29 4.1.1 Initial Transformation 30 4.1.2 Statement Generation 31 4.2 Paraphrase Generation System 37 4.2.1 Paraphrase Planning 38 4.2.2 Paraphrase Generation 44 4.3 Acceptability Ranker 45 Chapter 5 Experimental Setup 51 5.1 Paraphrase Table Contributions 51 5.2 Statement Acceptability Evaluation 52 5.3 Overall Quality Evaluation 55 Chapter 6 Evaluation and Analysis 59 6.1 Paraphrase Table Contributions 59 6.2 Statement Acceptability Evaluation 61 6.3 Overall Quality Evaluation 67 Chapter 7 Conclusion and Future Work 69 Reference 71 | |
dc.language.iso | en | |
dc.title | 透過改寫產生閱讀理解選擇題 | zh_TW |
dc.title | Generating Multiple-Choice Reading Comprehension Questions using Paraphrase | en |
dc.type | Thesis | |
dc.date.schoolyear | 102-2 | |
dc.description.degree | 碩士 | |
dc.contributor.oralexamcommittee | 陳孟彰,陳建錦,古倫維 | |
dc.subject.keyword | 自動出題,自動評量,閱讀理解,線上學習,選擇題,改寫生成,語句關係, | zh_TW |
dc.subject.keyword | question generation,automatic assessment,reading comprehension,e-learning,multiple choice questions,paraphrase generation,discourse relation, | en |
dc.relation.page | 74 | |
dc.rights.note | 有償授權 | |
dc.date.accepted | 2014-08-20 | |
dc.contributor.author-college | 管理學院 | zh_TW |
dc.contributor.author-dept | 資訊管理學研究所 | zh_TW |
顯示於系所單位: | 資訊管理學系 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-103-1.pdf 目前未授權公開取用 | 1.81 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。