請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/4439
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 江文瑜 | |
dc.contributor.author | Tiffany Ying-Yu Lin | en |
dc.contributor.author | 林盈妤 | zh_TW |
dc.date.accessioned | 2021-05-14T17:42:16Z | - |
dc.date.available | 2018-08-25 | |
dc.date.available | 2021-05-14T17:42:16Z | - |
dc.date.copyright | 2015-08-25 | |
dc.date.issued | 2015 | |
dc.date.submitted | 2015-08-18 | |
dc.identifier.citation | References
Agawu, K. (1992). Theory and practice in the analysis of the nineteenth-century 'Lied'. Music Analysis, 11 (1), 3-36. Aksnes, H. (2002). Perspectives of musical meaning: A study based on selected works by Geirr Tveitt. Oslo: Unipub AS. Atrey, P., Hossain, M., El Saddik, A., & Kankanhalli, M. (2010). Multimodal fusion for multimedia analysis: a survey. Multimedia Systems, 16, 345-379. Bain, J., Chaban, N. & Kelly, S. (2012). Crumbling giant, rising dragon? Chinese news media cartoon reflections on the Eurozone debt crisis. Communication, Politics & Culture, 45, 217-240. Baldry, A. and Thibault, P.J. (2006). Multimodal transcription and text analysis: A multimedia toolkit and coursebook. London: Equinox. Barcelona, A. (2002). Clarifying and applying the notions of metaphor and metonymy within cognitive linguistics: an update. In R. Dirven & R. Pörings (Eds.), Metaphor and metonymy in comparison and contrast (pp. 207-278). Berlin: Mouton de Gruyter. Bell, S. (2004). Drawing Tony. The Guardian, 17 July: 11 Benoit, W., & Klyukovski, A., McHale, J., & Airne, D. (2001). A fantasy theme analysis of political cartoons on the Clinton-Lewinsky-Starr affair. Critical Studies in Media Communication, 18, 377–394. Borgo, D. (2004). The play of meaning and the meaning of play in jazz. Journal of Consciousness Studies, 11(3-4), 174-190. Bostdorff, D.M. (1987). Making light of James Watt: A Burkean approach to the form and attitude of political cartoons. Quarterly Journal of Speech, 73, 43–59. Bounegru, L., & Forceville, C. (2011). Metaphors in editorial cartoons representing the global financial crisis. Visual Communication, 10(2), 209-29. Brower, C. (1997-1998). Pathway, blockage, and containment in density 21.5. Theory and Practice, 22-23, 35-54. Carroll, N. (1996). A note on film metaphor. In Theorizing the Moving Image (pp. 212-223). Cambridge: Cambridge University Press. Chuck, G. (2004). Musical meaning and cognitive operations of the embodied mind. Unpublished PhD dissertation, University of Rochester, Eastman School of Music. Cohn, N. (2007). A visual lexicon. The Public Journal of Semiotics, 1, 35–56. Cohn, N. (2010). The limits of time and transitions: Challenges to theories of sequential image comprehension. Studies in Comics, 1, 127–147. Conners, J.L. (1998) Hussein as enemy: The Persian Gulf War in political cartoons. Press/Politics, 3(3), 96–114. Cook, N. (1998). Analysing musical multimedia. Oxford: Oxford University Press. Coulson, S. (2001). Semantic leaps: Frame-shifting and conceptual blending in meaning construction. Cambridge: Cambridge University Press. Coulson, S. (2002). What’s so funny? Conceptual blending in humorous examples. Retrieved from http://www.cogsci.ucsd.edu/∼coulson/funstuff/funny.html Coulson, S., & Oakley, T. (2003). Metonymy and conceptual blending. In Panther, K. & L. L. Thornburg (Eds.), Metonymy and pragmatic inferencing (pp. 59-88). Amsterdam/Philadelphia: John Benjamins. Coulson, S., & Oakley, T. (2005). Blending and coded meaning: Literal and figurative meaning in cognitive semantics. Journal of Pragmatics, 37(10), 1510-1536. Coulson, S. (2006). Metaphor and conceptual blending. In K. Brown & A. H. Anderson (Eds.), The encyclopedia of language and linguistics (pp. 32–39). Oxford: Elsevier. Cox, A. W. (2001). The mimetic hypothesis and embodied musical meaning. Musicae Scientiae, 5 (2), 195-212. Craig, D., Nersessian, N., & Catrambone, R. (2002). Perceptual simulation in analogical problem solving. In L. Magnani & N. Nersessian (Eds.), Model-based reasoning: Science, technology, values (pp. 167-190). New York: Kluwer. Croft, W. (2002). The role of domains in the interpretation of metaphors and metonymies. In R. Dirven & R. Pörings (Eds.), Metaphor and metonymy in comparison and contrast (pp. 161-205). Berlin: Mouton de Gruyter. Davies, L. J. (1995). The multidimensional language of the cartoon: A study in aesthetics, popular culture, and symbolic interaction. Semiotica, 104, 165–211. Deignan, A. (2005). Metaphor and corpus linguistics (Vol. 6). Amsterdam/Philadelphia: John Benjamins. Diamond, M. (2002). No laughing matter: Post-September 11 political cartoons in Arab/Muslim newspapers. Political Communication, 19, 251–272. Dirven, R. (2002). Metonymy and metaphor: different mental strategies of conceptualization. In R. Dirven & R. Pörings (Eds.), Metaphor and metonymy in comparison and contrast (pp. 75-111). Berlin: Mouton de Gruyter. Edwards, J. L. (1997). Political cartoons in the 1988 presidential campaign: Image, metaphor, and narrative. New York/London: Garland. Edwards, J. L. (2001). Running in the shadows in campaign 2000. American Behavioral Scientist, 44, 2140–2151. Edwards, J. L., & Winkler, C. K. (1997). Representative form and the visual ideograph: The Iwo Jima image in editorial cartoons. Quarterly Journal of Speech, 83, 289–310. El Refaie, E. (2003). Understanding visual metaphor: The example of newspaper cartoons. Visual Communication 2(1), 75–96. El Refaie, E. (2009a). Metaphor in political cartoons: Exploring audience responses. In C. Forceville & E. Urios-Aparisi (Eds.), Multimodal metaphor (pp.173–196). Berlin: Mouton de Gruyter. El Refaie, E. (2009b). Multiliteracies: how readers interpret political cartoons. Visual Communication, 8(2), 181-205. Fauconnier, G. (1985). Mental spaces: Aspects of meaning construction in natural language. Cambridge, MA: MIT Press. Fauconnier, G. (1994). Mental spaces: Aspects of meaning construction in natural language. Cambridge, UK: Cambridge University Press Fauconnier, G., & Turner, M. (2002/2008). The way we think: Conceptual blending and the mind’s hidden complexities. New York: Basic Books. Feld, S. (1981). Flow like a waterfall: The metaphors of Kaluli musical theory. Yearbook for Traditional Music, 13, 22-47. Feld, S. (1982). Sound and sentiment: Birds, weeping, poetics, and song in Kaluli expressions. Philadelphia, PA: University of Pennsylvania Press. Fernandez-Duque, D., & Johnson M. (1999). Attention metaphors: How metaphors guide the cognitive psychology of attention. Cognitive Science 23: 83-116. Fillmore, C. J., (1985). Frames and the semantics of understanding. Quaderni di Semantica 6, 222-255. Fillmore, C. J., (2006). Frame semantics. In D. Geeraerts (Ed.), Cognitive linguistics: Basic Readings (pp. 373-400). Berlin: Mouton de Gruyter. Fillmore, C. J., & Atkins, B. T., (1992). Toward a frame-based lexicon: the semantics of RISK and its neighbors. In A. Lehrer & E. F. Kittay (Eds.), Frames, fields, and contrasts: New essays in semantic and lexical organization (pp. 75—102). NJ: Hillsdale. Forceville, C. (1994). Pictorial metaphor in advertisements. Metaphor and Symbolic Activity, 9 (1), 1–29. Forceville, C. (1996). Pictorial metaphor in advertising. London/New York: Routledge. Forceville, C. (2000). Compasses, beauty queens and other PCs: Pictorial metaphors in computer advertisements. Hermes, Journal of Linguistics, 24, 31-55. Forceville, C. (2006). Non-verbal and multimodal metaphor in a cognitivist framework: agendas for research. In G. Kristiansen, M. Achard, R. Dirven, & F. Ruiz de Mendoza Ibanes (Eds.), Cognitive linguistics: Current applications and future perspectives (pp. 379–402). Berlin/New York: Mouton de Gruyter. Forceville, C. (2007). Multimodal metaphor in ten Dutch TV commercials. Public Journal of Semiotics 1, 19-51. Forceville, C. (2008). Pictorial and multimodal metaphor in commercials. In E. F. Mc Quarrie & B. J. Phllips (Eds.), Go figure! New directions in advertising rhetoric (pp. 272-310). Armonk, NY: ME Sharpe. Forceville, C. (2012 a). Creativity in pictorial and multimodal advertising metaphors. Discourse and creativity, 113-132. Forceville, C. (2012 b). 14 The journey metaphor and the SourcePathGoal schema in Agnès Varda’s autobiographical gleaning documentaries. Beyond cognitive metaphor theory: Perspectives on literary metaphor, 76. Forceville, C. (2014). Relevance theory as model for analysing visual and multimodal communication. Visual Communication, 51-70. Berlin: Mouton de Gruyter. Forceville, C., & Urios-Aparisi, E. (Eds.). (2009). Multimodal metaphor. Berlin, Germany: Mouton de Gruyter. Gibbs, R. W. (1994). The poetics of mind: Figurative thought, language, and understanding. Cambridge: Cambridge University Press. Gibbs, R. W., Jr. ed. (2008). The Cambridge handbook of metaphor and thought. Cambridge: Cambridge University Press. Gibbs, R. W., Jr., & Colston, H. (1995). The psychological reality of Image Schemas and their transformations. Cognitive Linguistics, 6, 347-378. Gibbs, R. W., Jr., & Colston, H. (2012). Interpreting figurative meaning. New York, NY: Cambridge University Press. Gibbs, R. W., Jr., & Steen, G. J., eds. (1999). Metaphor in cognitive linguistics. Amsterdam: John Benjamins. Gislason, S. (2011). The sound of music. Persona Digital Books and Environmed Research Inc. Gleason, D. W. (2009). The visual experience of image metaphor: Cognitive insights into imagist figures. Poetics Today, 30, 423–470. Grady, J., Oakley, T., & Coulson, S. (1999). Conceptual blending and metaphor. In R. Gibbs (Ed.), Metaphor in cognitive linguistics (pp. 421-440). Amsterdam/Philadelphia: John Benjamins. Green, A. J. (2009). Mapping North America: Visual representations of Canada and the United States in recent academic work and editorial cartoons, American Review of Canadian Studies, 37, 130–149. Groarke, L. (2002). Towards a pragma-dialectics of visual argument. In F. van Eemeren (Ed.), Advances in pragmadialectics (pp. 137–151). Amsterdam, The Netherlands: Sic Sat. Grove, G. (2009). A dictionary of music and musicians. A.D. 1450-1880. Cambridge: Cambridge University Press. Hsu, H.C., & Su, L. I. (2014). Love in disguise: Incongruity between text and music in song. Journal of Pragmatics, 62, 136-150. Jakobson, R. (1956). Two aspects of language and two types of aphasic disturbance. In R. Jakobson & M. Halle (Eds.), Fundamentals of language (pp. 53-83). S-Gravenhage: Mouton. Johnson, M. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press. Johnson, M. (1993). Moral imagination: implications of cognitive science for ethics. Chicago: University of Chicago Press. Johnson, M. (2005). The philosophical significance of Image Schemas. In B. Hampe and J. E. Grady (Eds.), From perception to meaning. Image schemas in cognitive linguistics, (pp. 15-33). Berlin/New York: Mouton de Gruyter. Kaplan, S. T. (1990). Visual metaphors in the representation of communication technology. Critical Studies in Mass Communication,7 (1), 7–47 Kelley-R., S., & Westgate, V. (2007). Blaming Bush. Journalism Studies, 8, 755–77 Kövecses, Z. (2005). Metaphor in culture: Universality and variation. Cambridge: Cambridge University Press. Kövecses, Z. (2010). Metaphor: A practical introduction (2nd ed.). Oxford: Oxford University Press. Kramer, L., (1984). Music and poetry: The nineteenth century and after. Berkeley: University of California Press. Kuo, C-T. (2002). The study of newspaper images of the first ladies. Master’s Thesis. Tamkang University. Lakoff, G. (1993). The contemporary theory of metaphor. In A. Ortony (Ed.), Metaphor and thought (pp. 202–251). Cambridge: Cambridge University Press. Lakoff, G. (2004). Don’t think of an elephant! Know your values and frame the debate: The essential guide for progressives. Vermont: Chelsea Green. Lakoff, G., & Johnson, M. (1980/2003). Metaphors we live by. Chicago, IL: University of Chicago Press. Lakoff, G., & Johnson M. (1999). Philosophy in the Flesh: The embodied mind and its challenge to western thought. New York: Basic Books. Lakoff, G., & Nuñez, R. (2000). Where mathematics comes from: How the embodied mind brings mathematics into being. New York: Basic Books. Lakoff, G., & Turner, M. (1989). More than cool reason: A field guide to poetic metaphor. Chicago, IL: University of Chicago Press. Langer, S. K., (1953). Feeling and form: A theory of art developed from philosophy in a new key. Scribner, New York. Larson, S. (1997-1998). Musical forces and melodic patterns. Theory and Practice, 22-23, 55-71. Lin, M. H. (1987). The international news analysis in the national newspapers 1980-1986. Master’s Thesis. Chinese Culture University. Lin, Y. Y. (2009). The Chien-Ming Wang phenomenon: A critical metaphor model analysis of newspaper discourse in Taiwan. Master’s Thesis. National Taiwan University. Lin, T.Y.Y., & Chen, I.H. (2014). How semantics is embodied through visual representation: Image Schemas in the art of Chinese calligraphy. Proceedings of the 38th Annual Meeting of the Berkeley Linguistics Society, 328-337. Lin, T.Y.Y., & Chiang W.Y. (2015). Multimodal fusion in analyzing political cartoons: Debates on U.S. beef imports into Taiwan. Metaphor and Symbol, 30 (2), 137-161. Lumsden, L. (2010). Striking images: Visual rhetoric and social identify in the radical press, 1903–1917. Visual Communication Quarterly, 17, 225–240. McLuhan, M. (1964). The medium is the message. Hardwired, San Francisco, 8-9. Medhurst, M. J., & Desousa, M. A. (1981). Political cartoons as rhetorical form: A taxonomy of graphic discourse. Communication Monographs, 48, 197–236. Messaris, P. (1997) Visual persuasion: The role of images in advertising. Thousand Oaks, CA: Sage. Mittelberg, I., & Waugh, L. R. (2009). Metonymy first, metaphor second: A cognitive-semiotic approach to multimodal figures of thought in co-speech gesture. Multimodal metaphor, 329-356. Morrison, S. S. (1992). The feminization of the German Democratic Republic in political cartoons 1989-90. The Journal of Popular Culture, 25(4), 35–52. Müller, C., & Cienki, A. (2009). Words, gestures, and beyond: Forms of multimodal metaphor in the use of spoken language. Multimodal metaphor, 297-328. Oakley, T., & Hougaard, A. (Eds.). (2008). Mental spaces in discourse and interaction (Vol. 170). Amsterdam/Philadelphia: John Benjamins Publishing. Parrill, F., & Sweetser, E. (2004). What we mean by meaning: Conceptual integration in gesture analysis and transcription. Gesture, 4(2), 197-219. Peirsman, Y. & Geeraerts, D. (2006). Metonymy as a prototypical category. Cognitive Linguistics 17, 269-316. Philippe, R. (1982). Political graphics: Art as weapon. Oxford: Phaidon Press. Radden, G. (2000). How metonymic are metaphors. In R. Dirven & R. Pörings (Eds.), Metaphor and metonymy at the crossroads: a cognitive perspective, (pp. 93-108). Berlin: Mouton de Gruyter. Saslaw, J. K. (1997-1998). Life forces: Conceptual structures in Schenker’s free composition and Schoenberg’s musical idea. Theory and Practice, 22-23, 17-33. Schilperoord, J., & Maes, A. (2009). Visual metaphorical conceptualization in editorial cartoons. In C. Forceville, & E. Urios-Aparisi (Eds.), Multimodal metaphor (pp. 213–240). Berlin: Mouton de Gruyter. Schilperoord, J. (2013). Raising the issue: A mental-space approach to Iwo Jima-inspired editorial cartoons. Metaphor & Symbol, 28(3), 185-212. Schoenberg, A. (1983). Structural functions of harmony (rev. ed.) London: Faber and Faber. Semino, E., & Masci, M. (1996). Politics is football: metaphor in the discourse of Silvio Berlusconi in Italy. Discourse & Society, 7(2), 243-269. Seymour-Ure, C. (1998). Preface. In J. Newton (Eds.) Political cartoons of 1998, (p.3). Canterbury: Centre for the Study of Cartoons and Caricature. Spitzer, M. (2004). Metaphor and musical thought. Chicago, IL: University of Chicago Press. Sweetser, E. (1990). From etymology to pragmatics. Metaphorical and cultural aspects of semantic structure. Cambridge: Cambridge University Press. Teng, N. Y. (1999). The language of thought and the embodied nature of language use. Philosophical Studies, 94, 237–251. Teng, N. Y. & Sun, S. (2002). Grouping, simile, and oxymoron in pictures: A design-based cognitive approach. Metaphor and Symbol, 17(4): 295–316. Templin, C. (1999) Hillary Clinton as threat to gender norms: Cartoon images of the First Lady, Journal of Communication Inquiry 23(1), 20–36. Tsai, C. C. (2006). Stylish chameleon: An exploratory examination on Taiwan Apple’s Daily. Master’s Thesis. National Taipei University. Turner, M. (1991). Reading minds: The Study of English in the Age of Cognitive Science. Princeton, NJ: Princeton University Press. Urios-Aparisi, E. (2009). Interaction of multimodal metaphor and metonymy in TV commercials: Four case studies. In C. Forceville, & E. Urios-Aparisi (Eds.), Multimodal metaphor (pp. 95–117). Berlin: Mouton de Gruyter. Veale, T., Feyaerts, K., & Brône, G. (2006). The cognitive mechanisms of adversarial humor. Humor: International Journal of Humor Research, 19 (3), 305-339. Vultee, F. (2007). Dr. FDR and Baby War: The world through Chicago political cartoons before and after Pearl Harbor. Visual Communication Quarterly, 14, 158–175. Walker, M.E. 2000. Movement and metaphor: Towards an embodied theory of music cognition and hermeneutics. Bulletin of the Council for Research in Music Education, 145 (Summer), 27-42. Whittock, T. (1990). Metaphor and film. Cambridge: Cambridge University Press. Winter, S. (2001). A clearing in the forest: Law, life, and mind. Chicago: University of Chicago Press. Yu, N. (2011a). A decompositional approach to metaphorical compound analysis: The case of a TV commercial. Metaphor and Symbol, 26, 243-259. Yu, N. (2011b). Beijing Olympics and Beijin opera: A multimodal metaphor in a CCTV Olympics commercial. Cognitive Linguistics, 22, 595-628. Zbikowski, L. M. (1991). Large-scale rhythm and systems of grouping. Unpublished PhD dissertation, Yale University, New Haven, CT. Zbikowski, L. M. (1998). Metaphor and music theory: Reflections from cognitive science. Music Theory Online, 4 (1), January. (http://smt.vesb.edu/mto/issues/mto.98.4.1.html) Zbikowski, L. M. (1999). The blossoms of ‘Trockne Blumen’: Music and text in the early nineteenth century. Music Analysis, 18, 307-345. Zbikowski, L. M. (2002). Conceptualizing music: cognitive structure, theory, and analysis. Oxford: Oxford University Press. Zbikowski, L. M. (2008). Metaphor and music. In R. W. Gibbs. Jr. (Eds.), The Cambridge handbook of metaphor and thought (pp. 502-524). Cambridge: Cambridge University Press. Zbikowski, L. M. (2009). Music, language, and multimodal metaphor. In C. J. Forceville and E. Urios-Aparisi (Eds.), Multimodal metaphor (pp. 359-381). Berlin: Mouton de Gruyter. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/4439 | - |
dc.description.abstract | 近年來認知語言學領域中的隱喻相關研究受到高度重視,語言中的隱喻如何型塑並影響我們的思維與行動,在認知科學領域,心理學,數學,藝術,哲學等領域均獲得廣泛的討論與研究,非語言隱喻也隨之逐漸在圖像領域及多模態/多媒體的研究中受到注意。然而,過去的研究大多著重於語言與其他媒介之間一對一的對應關係以及認知,然而本研究認為多模態與語言之間的關係不只有一對一的關係,應可視為多重組合關係的連續體(continuum),豐富且複雜,因此本研究提出創新的互動式詮釋理論:多模態融合聚變理論(multimodal fusion model),提供多模態分析以解釋語言與其他媒介之間一對多的對應關係,探討特定主題及抽象概念如何再現於多模態體裁(multimodal genre)中,以政治漫畫與藝術歌曲為例證,深入了解 (1)『美國牛肉進口』這個熱門的政治議題,如何透過眾多的政治漫畫呈現於不同立場的報紙中? (2) 經典詩作『偶然』又如何透過樂曲中的聽覺與視覺,再現於四個版本的藝術歌曲中? 本論文進一步結合閱聽者訪談結果,審視閱聽者如何詮釋並理解多模態隱喻於特殊體裁。本文進一步提出顯著的多模態特性與多模態視覺/聽覺/語言提示(visual/aural/verbal cues) 均可協助促進多模態隱喻的運作與詮釋。
本研究以多模態融合聚變理論為基本架構,建構了美牛進口相關政治漫畫的多模態語料庫,歷時收集涵蓋台灣兩大報『自由時報』與『聯合報』共56篇政治漫畫。本文主張多模態融合聚變結合視覺,語言,與概念三大模式,衍生自轉喻與隱喻(metonymic-metaphoric)共同組成的兩大網絡:相關化轉喻網路(related metonymic network) 和多元化隱喻網路 (diversified metaphoric network)。本研究證明多模態融合聚變是政治漫畫中重要且重複運用的表現技巧,具有將複雜抽象的政治概念有效率地濃縮封裝(encapsulating)的認知功能,並產生諷刺與幽默的效果。本分析進一步強調轉喻的重要性,證明轉喻與隱喻彼此密切交織(interwoven)於多模態融合聚變中,蘊藏於概念情境(conceptual scenarios) 如政治是遊戲(POLITICS IS WAR)與政治是戰爭(POLITICS IS WAR)的隱喻對應範疇內。本研究發現雖然兩報的批判性訊息與相異的政治立場均浮現自多模態融合聚變理論,卻分別透過顯著的視覺特色與語言情境,更加強化與對比。 本研究以四首為徐志摩詩作『偶然』譜寫的藝術歌曲為例證,提出以隱喻為基礎的譜面分析,進而發現此體裁中特殊的現象:『隱喻之鏈』(chain of metaphor) ,即歌曲中的多模態隱喻彼此可前後呼應,互相串聯於整首歌曲中,以維持整體的連貫性。另外,本研究發現藝術歌曲中的多模態隱喻可透過轉喻的方式再現(metonymic representation) 於歌曲中(如:模擬雲的視覺形狀於譜面或模擬海浪的節奏於伴奏中)。作者更進一步提出藝術歌曲中的多模態隱喻兩大面向:具體形象(concrete image)與抽象隱喻延伸(abstract metaphorical extension),透過分析提出相對應的音樂技巧以及具體抽象光譜(concrete-abstract continuum)為四首歌曲分類。本文並從身體經驗(embodied)為基礎的概念隱喻出發,發掘抽象概念如空間關係和情緒均可對應於音樂中,如透過音量/音域高低,音色明暗等音樂特性呈現。 本研究進一步整合閱聽者反應的量化與質化分析,從閱聽者訪談的研究結果中發現,閱聽者對於政治漫畫的高度理解,來自有效率的人物辨識,背景理解與多模態之間的有效且互動式的結合,而閱聽者對於藝術歌曲的高度理解則來自能分辨藝術歌曲中的具體形象與抽象意涵的詮釋,詮釋過程中所建立的對應關係與閱聽者對於藝術歌曲的喜好度具有正面相關,不同版本的喜好度也間接反應了閱聽者如何感知及詮釋藝術歌曲中語言與聽覺的融合下所產生的音樂效應。 本論文從分析者與閱聽者的視角,探究視覺,聽覺,與概念如何互動,整合,並透過多模態隱喻詮釋,本研究希望拓展以多模態隱喻為主題的跨領域研究,針對特定的多模態體裁深入分析,並結合認知與語用學的觀點,進一步理解多模態體裁中的詮釋與審美經驗歷程。 | zh_TW |
dc.description.abstract | In the past few decades, studies on how verbal metaphors shape our thoughts have been widely discussed in the filed of cognitive science, cognitive linguistics, psychology, mathematics, art, and philosophy, etc. Under this view, “non-verbal” metaphors have also received considerable attention, while previous studies mainly focused on the mental processing and one-on-one correspondence between language and other mode, especially the pictorial mode. However, this study believes the relations between multimodalities can be viewed as a complex continuum of various kinds of combinations. Therefore, this study proposes an alternative interactive interpretation model, the Multimodal Fusion Model, to account for the one-on-many relationship between language and multimodality (visual and aural modes) and to explore how certain topic/issue has been represented in various forms in distinct genre. Based on the evidence from the multimodal genre of political cartoons and poetry music, we examined (1) how the hotly debated topic, the U.S. beef import issue, has been represented in various political cartoons in different newspapers and (2) how a classic poem (i.e. Serendipity) has been conceptualized in four versions of songs. We further incorporate the audience response analysis from the interview surveys to examine how the audience actually interprets the multimodal genre. Our findings also show how prominent multimodal features and multimodal cues (visual/aural/verbal cues) help facilitate the interpretation process of multimodal metaphor in specific genre.
This study constructs a multimodal corpus involving 56 political cartoons with regard to U.S. beef import issues as reported in two dominant Taiwanese newspapers, the Liberty Times and United Daily News. Our corpus shows that multimodal fusion combining the visual mode, verbal mode, and the conceptual level evolves from two metonymic-metaphoric networks, i.e., related metonymic network and diversified metaphoric network. The result demonstrates that multimodal fusion is a significant and recurrent representation technique in the genre of political cartoon and has the cognitive function of encapsulating the abstract complex political debates efficiently with irony and humorous effect. In addition, this study emphasizes the important role of metonymy and demonstrates how metonymies and metaphors are interwoven in the process of multimodal fusion, which underlies the metaphorical mappings of conceptual scenarios related to “POLITICS IS GAME” and “POLITICS IS WAR”. Although the critical messages and distinct political stances in two newspapers both emerged through multimodal fusion, they are highlighted and contrasted through prominent visual features and verbal context in political cartoons. Based on the evidence from four versions of poetry music composed for the poem “Serendipity” by Hsu Chih-Mo, this study provides a metaphor-based musical analysis under the scope of multimodal fusion model. We discovered the “chain of metaphors” as an interactive and echoing relationship between metaphors that creates a holistic representation of multimodal metaphor combining the verbal and aural mode in the genre of poetry music. Furthermore, the results show the metonymic representations of metaphor in poetry music have been realized through the “pictorial effect” of partial visualization of cloud image on the score representing CLOUD metaphor and aural simulation of wave rhythm representing SEA metaphor, etc. Through cross-comparison analysis, we propose two major aspects of metaphor, the “concrete image” and “abstract metaphorical extension”, have been highlighted differently through musical techniques and features such as dynamics, pitch, and timbre, etc. in four versions of songs. Moreover, this study provides a concrete-abstract continuum as a categorization of composing patterns and musical effects. Viewing from the embodied perspective, our findings also show that the concrete relationship of space and abstract attributes of emotion can be mapped onto the representations of prominent musical features in poetry music. This study further incorporates the quantitative and qualitative analysis from audience response survey. The results show that higher level of audience interpretation in political cartoons relies on the effective visual recognition of caricatures, comprehension of verbal and contextual information, and interactive connection of the verbal mode, visual mode, and conceptual level. On the other hand, the higher level of audience interpretation in poetry music is related to the distinction between the concrete image and abstract metaphorical extension. The results also suggest that the audience’s preference is relevant to the correspondence between the verbal and aural mode, which implicitly reflects how the audience “feels” about the musical effect and aesthetic functions created from multimodal fusion in different versions of songs. From the perspectives of researcher and audience, this study investigates how verbal mode, visual mode, aural mode, and conceptual level are interacted, integrated, and interpreted through multimodal fusion. We hope to shed light on the interdisciplinary studies on multimodality and the interface between the cognitive mechanism and pragmatic multimodal use of language, picture, music, and the aesthetic experience of the multimodality appreciation process. | en |
dc.description.provenance | Made available in DSpace on 2021-05-14T17:42:16Z (GMT). No. of bitstreams: 1 ntu-104-D98142002-1.pdf: 28106802 bytes, checksum: 6990ac339a10a4321f055e95ab54dcad (MD5) Previous issue date: 2015 | en |
dc.description.tableofcontents | Table of Contents
Signature Page -------------------------------------------------------------------------i Acknowledgements -------------------------------------------------------------------ii Abstract in Chinese -------------------------------------------------------------------iv Abstract in English -------------------------------------------------------------------vi Table of Contents----------------------------------------------------------------------1 List of Figures -------------------------------------------------------------------------4 List of Tables --------------------------------------------------------------------------6 Chapter 1 Introduction 7 1.1 Background Information of U.S. Beef Imports 11 1.2 Background Information of Poetry Music: “Serendipity” 14 1.3 Complexity in Multimodality: Multimodal Fusion Model 16 1.4 Multimodal Fusion in Political Cartoons 26 1.4.1 Metonymic-Metaphoric Network and Conceptual Scenarios in Political Cartoon 26 1.4.2 The Conceptual Metaphor and Prominent Visual Features Contrast Functions as Visual Cues 29 1.4.3 Genre: Cognitive-Pragmatic Functions and Critical Effects in Political Cartoons 30 1.4.4 Audience Response to Multimodal Fusion in Political Cartoon 30 1.5 Multimodal Fusion in Analyzing Poetry Music 32 1.5.1 Metonymic-Metaphoric Network: Metonymic representation of Metaphor and Chain of Metaphor in Poetry Music 33 1.5.2 The Conceptual: Embodied Basis of Conceptual Metaphor 34 1.5.3 Multimodal Cues in Poetry Music 36 1.5.4 Genre: Musical Effects and Aesthetic Functions 36 1.5.5 Audience Response to Multimodal Fusion in Poetry Music 38 1.6 Organization of the Dissertation 39 Chapter 2 Literature Review and Theoretical Background 42 2.1 Studies on Political Cartoon 42 2.2 Studies on Music and Language 48 2.3 Theoretical Background 53 2.3.1 Conceptual Metaphor Theory and Multimodal Metaphor 54 2.3.2 Conceptual Integration Theory 58 2.3.3 Special Focus on Metonymy and Metaphor 75 2.4 Our Proposal: Multimodal Fusion Model 78 Chapter 3 Multimodal Fusion in Political Cartoon: Debates on U.S. Beef Imports into Taiwan 82 3.1 Data Collection: Multimodal Corpus of Political Cartoon 82 3.2 Data Analysis 84 3.2.1 Related Metonymic Network: Productive Visual Images 87 3.2.2 Diversified Metaphoric Network: Prominent Verbal Cues 100 3.3 Conceptual Scenario and Conceptual Metaphor 110 3.4 Multimodal Fusion and Political Stance 115 3.4.1 Different Targets of Bull Metonymy in the Same Scenario 115 3.4.2 The Personified Bull in Different Scenarios 119 3.4.3 Different Representations of Uncle Sam in Different Scenarios 123 Chapter 4 Audience Response to Multimodal Fusion in Political Cartoon 128 4.1 Questionnaire Survey: Participants’ Response 128 4.2 Survey Procedures 129 4.3 Results and Discussion 132 4.3.1 Significant Differences in the Interpretation Level 133 4.3.2 Political Stance Identification 137 4.3.3 The Involvement of Conceptual Scenario 138 4.3.4 The Distribution of the Conceptual Metaphor 142 4.3.5 Effective Multimodal Fusion and Interpretation 144 Chapter 5 Multimodal Fusion in Poetry Music: The Encounter between Language and Music in “Serendipity” 147 5.1 Data Description of Poetry Music: “Serendipity” 147 5.2 Data Analysis 148 5.2.1 Version 1 154 5.2.2 Version 2 159 5.2.3 Version 3 165 5.2.4 Version 4 169 5.3 Discussion 171 Chapter 6 Audience Response to Multimodal Fusion in Poetry Music 180 6.1 Questionnaire Survey: Participants’ Response 180 6.2 Survey Procedures 181 6.3 Results and Discussion 184 6.3.1 Matching Level of the Concrete Image 185 6.3.2 Preference among Four Versions of Songs 190 6.3.3 Multimodal Fusion and Interpretation: Different Focuses on the Multimodal and Conceptual level 192 Chapter 7 Conclusion 194 7.1 Multimodal Fusion in Political Cartoon 196 7.2 Multimodal Fusion in Poetry Music 199 7.3 Audience Interpretation and Multimodal Fusion 201 7.4 Concluding Remarks 204 Appendix 1: Word-to-word Translation of the Poem ‘Serendipity’: 206 Appendix 2: Political Cartoon Survey Questionnaire 208 Appendix 3: Poetry Music Survey Questionnaire 219 Appendix 4: Statistical Data of Questionnaire Surveys 228 References 233 | |
dc.language.iso | en | |
dc.title | 多模態,隱喻,與詮釋的交會:以政治漫畫與藝術歌曲為佐證 | zh_TW |
dc.title | The Encounter among Multimodality, Metaphor, and Interpretation: Evidence from Political Cartoons and Poetry Music | en |
dc.type | Thesis | |
dc.date.schoolyear | 103-2 | |
dc.description.degree | 博士 | |
dc.contributor.oralexamcommittee | 鄧育仁,張榮興,蘇以文,呂佳蓉 | |
dc.subject.keyword | 多模態融合聚變理論,多模態隱喻/轉喻,閱聽者反應,多模態提示,多模態體裁, | zh_TW |
dc.subject.keyword | Multimodal Fusion Model,multimodal metaphor/metonymy,audience response,multimodal cues,multimodal genre, | en |
dc.relation.page | 249 | |
dc.rights.note | 同意授權(全球公開) | |
dc.date.accepted | 2015-08-18 | |
dc.contributor.author-college | 文學院 | zh_TW |
dc.contributor.author-dept | 語言學研究所 | zh_TW |
顯示於系所單位: | 語言學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-104-1.pdf | 27.45 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。