Skip navigation

DSpace

機構典藏 DSpace 系統致力於保存各式數位資料(如:文字、圖片、PDF)並使其易於取用。

點此認識 DSpace
DSpace logo
English
中文
  • 瀏覽論文
    • 校院系所
    • 出版年
    • 作者
    • 標題
    • 關鍵字
    • 指導教授
  • 搜尋 TDR
  • 授權 Q&A
    • 我的頁面
    • 接受 E-mail 通知
    • 編輯個人資料
  1. NTU Theses and Dissertations Repository
  2. 管理學院
  3. 資訊管理學系
請用此 Handle URI 來引用此文件: http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/84101
完整後設資料紀錄
DC 欄位值語言
dc.contributor.advisor黃明蕙(Ming-Hui Huang)
dc.contributor.authorYu-Zhi Liuen
dc.contributor.author劉育志zh_TW
dc.date.accessioned2023-03-19T22:04:47Z-
dc.date.copyright2022-08-05
dc.date.issued2022
dc.date.submitted2022-07-19
dc.identifier.citation1. Antweiler, W., & Frank, M.Z. (2004). Is all that talk just noise? The information content of Internet stock message boards. Journal of Finance, (59:3), 1259-1294. 2. Antweiler, W., & Frank, M.Z. (2006). Do US Stock Markets Typically Overreact to Corporate News Stories. SSRN Electronical Journal, (10:2139). 3. Bing, Y., Hao, J.K., & Zhang, S.C. (2012). Stock Market Prediction Using Artificial Neural Networks. Advanced Engineering Forum, 6-7, 1055-1060. 4. Black, F. (1986). Noise. Journal of Finance, (59:3), 1259-1294. 5. Breiman, L. (2001). Random Forests. Machine Learning, (45), 5-32. 6. Breiman, L. (2001). Random Forest. Machine Learning, (45), 5-32. 7. Brock, W., Lakonishok, J., & LeBaron, B. (1992). Simple Technical Trading Rules and the Stochastic Properties of Stock Returns. Journal of Finance, (47:5), 1731-1764. 8. Brown, G.W. (1999). Volatility, Sentiment, and Noise Traders. Financial Analysts Journal, (55:2), 82-90. 9. Butler, K.C., & Malaikah, S.J. (1992). Stock returns: Kuwait and Saudi Arabia. Journal of Banking and Finance, (16), 197-210. 10. Chan, W.S. (2003). Stock Price Reaction to News and No-News: Drift and Reversal after Headlines. Journal of Financial Economics, (16:2), 223-260. 11. Chen, K., Zhou, Y., & Dai, F. (2015). A LSTM-based method for stock returns prediction: A case study of China stock market. 2015 IEEE International Conference on Big Data (Big Data), 2823-2824. 12. Chaudhury, M., & Piccoli, P. (2017). Stock Overreaction to Extreme Market Events. The North American Journal of Economics and Finance, (41), 97-111. 13. Cootner, Paul H. (1962). Stock Prices: Random vs. Systematic Changes. Industrial Management Review, (3), 24-45. 14. Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, (20), 273-297. 15. De Bondt, W.F.M., & Thaler, R.H. (1985). Does the Stock Market Overreact? Journal of Finance, (40:3), 793-805. 16. De Long, J.B., Shleifer, A., Summers, L.H., & Waldmann, R.J. (1990). Noise Trader Risk in Financial Markets. Journal of Political Economy, (98:4), 703-738. 17. Devlin, J., Chang, M.W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Google. 18. Dupuis, M.J., Pham, S., & Weiss, M. Facebook vs. Twitter: An Examination of Differences in Behavior Type and Substance Based on Psychological Factors. 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, 1834-1840. 19. Fama, E.F. (1965). The Behavior of Stock-Market Prices. The Journal of Business, (38:1), 34-105. 20. Fama, E.F. (1970). Efficient Capital Markets: A Review of Theory and Empirical Work. The Journal of Finance, (25:2), 383-417. 21. Fama, E.F., Fisher, L., Jensen, M.C., & Roll, R. (1969). The Adjustment of Stock Prices to New Information. International Economic Review, (10:1), 1-21. 22. Fama, E.F., & French, K.R. (1993). Common risk factors in the returns on stocks and bonds. Journal of Financial Economics, (33:1), 3-56. 23. Fisher, K.L., & Statman, M. (2019). Investor Sentiment and Stock Returns. Financial Analysts Journal, (56:2), 16-23. 24. Gidófalvi, G. (2001). Using News Articles to Predict Stock Price Movements. 25. Hiew, J.Z.G., Huang, X., Mou, H., Li, D., Wu, Q., Xu, Y. (2019). BERT-based Financial Sentiment Index and LSTM-based Stock Return Predictability. NeurIPS. 26. Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, (9:8), 1735-1780. 27. Huberman, G., & Regev, T. (2001). Contagious Speculation and a Cure for Cancer: A Nonevent that Made Stock Prices Soar. Journal of Finance, (1:1), 387-396. 28. Jing, N., Wu, Z., & Wang, H. (2021). A hybrid model integrating deep learning with investor sentiment analysis for stock price prediction. Expert Systems with Applications, (178). 29. Jiang, F., Lee, J., Martin, X., & Zhou, G. (2019). Manager Sentiment and Stock Returns. Journal of Financial Economics, (132:1), 126-149. 30. Joshi, K., H. N., B., & Rao, J. (2016). Stock Trend Prediction Using News Sentiment Analysis. International Journal of Computer Science and Information Technology, (8:3), 67-76. 31. Kahneman, D., & Tversky, A. (1979). Prospect Theory: An Analysis of Decision under Risk. Econometrica, (47:2), 263-291. 32. Kendall, M.G. (1953). The Analysis of Economic Time Series. Journal of the Royal Statistical Society (Series A, XCVI), 11-25. 33. Kordonis, J., Symeonidis, S., & Arampatzis, A. (2016). Stock Price Forecasting Via Sentiment Analysis on Twitter. In: Proceedings of the 20th Pan-Hellenic Conference on Informatics, 1-6. 34. Kyle, A.S. (1985). Continuous Auctions and Insider Trading. Econometrica, (53:6), 1315-1335. 35. Lecun, Y, Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, (86:11), 2278-2324. 36. Lee, Y.T. (2021). 聽經濟大調查. CommonWealth Magazine, May 21. (https://www.cw.com.tw/article/5115003?template=transformers, accessed June 30, 2021). 37. Li, F., & Liu, C. (2009). Application Study of BP Neural Network on Stock Market Prediction. In: 2009 Ninth International Conference on Hybrid Intelligent Systems, 174-178. 38. Li, Q., Wang, T.J., Li, P., Liu, L., Gong, Q., & Chen, Y. (2014). The effect of news and public mood on stock movements. Information Sciences, (278), 826-840. 39. Li, Q., Tan, J., Wang, J., & Chen, H. (2021). A Multimodal Event-Driven LSTM Model for Stock Prediction Using Online News. IEEE Transactions on Knowledge and Data Engineering, (33:10), 3323-3337. 40. Lintner, J. (1965). The valuation of risk assets on the selection of risky investments in stock portfolios and capital budgets. Review of Economics and Statistics, (47), 13-37. 41. Ma, W.Y., & Chen, K.J. (2003). Introduction to CKIP Chinese word segmentation system for the first international Chinese Word Segmentation Bakeoff. Association for Computational Linguistics, (17), 168-171. 42. Ma, Q. (2020). Comparison of ARIMA, ANN and LSTM for Stock Price Prediction. E3S Web of Conferences. 43. Malkiel, B.G. (2003). The Efficient Market Hypothesis and Its Critic. Journal of Economic Perspectives, (17:1), 59-82. 44. Mandelbrot, B. (1966). Forecasts of Future Prices, Unbiased Markets, and “Martingale” Models. The Journal of Business, (39), 242. 45. Mao, H., Counts, S., & Bollen, J. (2011). Predicting Financial Markets: Comparing Survey, News, Twitter and Search Engine Data. 46. Mikolov, T., Chen, K., Corrado, C., & Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. Google. 47. Nguyen, H.T., Shirai, K., & Velcin, J. (2015). Sentiment analysis on social media for stock movement prediction. Expert Systems with Applications, (42:24), 9603-9611. 48. Nikou, M., Mansourfar, G., & Bagherzadeh, J. (2019). Stock price prediction using DEEP learning algorithm and its comparison with machine learning algorithms. Intelligent Systems in Accounting, Finance and Management. 49. Nisar, T.M., & Yeung, M. (2018). Twitter as a tool for forecasting stock market movements: A short-window event study. The Journal of Finance and Data Science, (4:2), 101-119. 50. Nofer, M. (2015). The Value of Social Media for Predicting Stock Returns. Springer Vieweg, Wiesbaden. 51. Park, C., & Irwin, S. (2007). What do we know about the profitability of technical analysis? Journal of Economic Surveys, (21), 786-826. 52. Pennington, J., Socher, R., & Manning, C. (2014). GloVe: Global Vectors for Word Representation. 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), (14), 1532-1543. 53. Prechter, R. (1999). The Wave Principle of Human Social Behavior and the New Science of Socionomics. New Classics Library, Gainesville, GA. 54. Porshnev, A., Redkin, I., & Shevchenko, A. (2015). Machine Learning in Prediction of Stock Market Indicators Based on Historical Data and Data from Twitter Sentiment Analysis. IEEE 13th International Conference on Data Mining Workshops, 440-444. 55. Qian, B.R., & Rasheed, K. (2007). Hurst Exponent and Financial Market Predictability. Applied Intelligence, (26), 25-33. 56. Ranco, G., Aleksovski, D., Caldarelli, G., Grcar, M., & Mozetic, I. (2015). The Effects of Twitter Sentiment on Stock Price Returns. PLoS One (10:9). 57. Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, (65:6), 386-408. 58. Rossi, F., & Conan-Guez, B. (2005). Functional multi-layer perceptron: a non-linear tool for functional data analysis. Neural Networks, (18:1), 45-60. 59. Rumelhart, D.E., Hinton, G.E., & Williams, R.J. (1985). Learning internal representations by error propagation. Tech. rep. ICS 8504. San Diego, California: Institute for Cognitive Science, University of California. 60. Samuelson, P.A. (1965). Proof That Properly Discounted Present Values of Assets Vibrate Randomly. Industrial Management Review, (6), 41-49. 61. Sainath, T.N., Vinyals, O., Senior, A., & Sak, H. (2015). Convolutional, Long Short-Term Memory, Fully Connected Deep Neural Networks. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4580-4584. 62. Sharpe, W.F. (1964). Capital asset prices: A theory of market equilibrium under conditions of risk. The Journal of Finance, (19), 425-442. 63. Sherstinsky, A. (2020). Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network. Physica D: Nonlinear Phenomena, (404). 64. Shewalkar, A., Nyavanandi, D., & Ludwig, S. (2019). Performance Evaluation of Deep Neural Networks Applied to Speech Recognition: RNN, LSTM and GRU. Journal of Artificial Intelligence and Soft Computing Research, (9), 235-245. 65. Shleifer, A. (2000). Inefficient Markets: An Introduction to Behavioural Finance. Oxford University Press, USA. 66. Shleifer, A., & Vishny, R.W. (1997). The Limits of Arbitrage. Journal of Financial Economics, (52:1), 35-55. 67. Shleifer, A., & Summers, L.H. (1990). The Noise Trader Approach to Finance. Journal of Economic Perspectives, (4:2), 19-33. 68. Shiller, R.J. (1981). Do Stock Prices Move Too Much to Be Justified by Subsequent Changes in Dividends? The American Economic Review, (71:3), 421-436. 69. Sousa, M.G., Sakiyama, K., Rodrigues, L.d.S., Moraes, P.H., Fernandes, E.R., & Matsubara, E.T. (2019). BERT for Stock Market Sentiment Analysis. 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), 1597-1601. 70. Sutskever, I., Vinyals, O., & Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. Advances in Neural Information Processing Systems, (27). 71. Taiwan Stock Exchange. Sources of Capital 2021. 72. Tetlock, P.C. (2007). Giving Content to Investor Sentiment: The Role of Media in the Stock Market. The Journal of Finance, (62:3), 1139-1168. 73. Tetlock, P.C. (2008). More Than Words: Quantifying Language to Measure Firms’ Fundamentals. The Journal of Finance, (63:3), 1437-1467. 74. Thaler, R.H. (1993). Advances in behavioral finance. Russell Sage Foundation. 75. Thaler, R H. (2016). Behavioral Economics: Past, Present and Future. American Economic Review, (106:7), 1577-1600. 76. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., & Polosukhin, I. (2017). Attention Is All You Need. NIPS '17: Proceedings of the 31st International Conference on Neural Information Processing Systems, 6000-6010. 77. Wang, J., Yang, Y., Mao, J., Huang, Z., Huang, C., & Xu, W. (2016). CNN-RNN: A Unified Framework for Multi-label Image Classification. Computer Vision and Pattern Recognition. 78. Yao, J.Q., Feng, X., Wang, Z.J., Ji, R.R., Zhang, W.T. (2021). Sentiment and Market Impacts: The Construction of Chinese Sentiment Dictionary in Finance. Journal of Management Sciences in China, (24:5), 26-46. 79. Zhang, X., Fuehres, H., & Gloor, P.A. (2011). Predicting Stock Market Indicators through Twitter – “I Hope It Is Not as Bad as I Fear.” Procedia - Social and Behavioral Sciences, (26), 55-62. 80. Zhai, Y., Hsu, A., & Halgamuge, S.K. (2007). Combining News and Technical Indicators in Daily Stock Price Trends Prediction. Advances in Neural Networks – Isnn 2007, 1087-1096. 81. Zhou, Z., Zhao, J., & Xu, K. (2016). Can Online Emotions Predict the Stock Market in China? Social and Information Networks, (10041), 328-342.
dc.identifier.urihttp://tdr.lib.ntu.edu.tw/jspui/handle/123456789/84101-
dc.description.abstract在主流經濟文獻中,效率市場假說(The efficient market hypothesis, EMH)假設投資人為理性,從而技術指標應能提供合理的報酬。然而文獻指出這樣的假說並不能適用於劇烈震盪的股市。行為經濟學家指出情緒在證券價格決策中也佔有地位,因而引申出兩個問題:如何有效的擷取情緒以及情緒如何影響市場價格。 我們嘗試了以下三個模型:「純技術指標模型」、「情緒字典模型」、「自標註模型」,在不同的移動平均與最小文本長度下,「純技術指標模型」在一日移動平均與最小文本長度提供了最好的預測結果,其RMSE表現好於其他模型10-30%。 在情緒影響市場方面,我們提出以情緒字典與手標資料來微調(fine-tuning)BERT模型來做為情緒分類器。此法改善擷取情緒的效率,同時在我們的測時集中達到了93%的F1分數。 實驗結果顯示,加入情緒會使的預測的指數向上偏移,亦即對於現實世界的交易而言,加入情緒並不是個好選擇。zh_TW
dc.description.abstractThe efficient market hypothesis (EMH) in mainstream financial literature assumes that market behavior is rational; thus, technical indicators should provide reasonable predictions for the fluctuations of stock markets. However, existing literature points out that the hypothesis may not be sufficient for predicting highly volatile stock fluctuations. Behavioral economists have proposed that the emotions of investors can also influence stock prices. Therefore, we arrive at two questions: how to extract emotions more effectively and how emotions affect predictions. For the first question, we test three different models for stock price predictions, namely “technical indicator only model ,” “dictionary emotion model,” and “self-labeled emotion model,” with the inputs of different moving averages and minimum text lengths. The results show that the “technical indicator only model” performed the best with a 1-day moving average and a minimum length of three words. It outperformed the other two models by 10–30% in RMSE. For the second question, we proposed extracting emotions by fine-tuning BERT as the emotion classifier with dictionary and hand-labeled data. The method compensates for disadvantages of common ways to extract emotions, and achieves over a 93% F1 score in our testing data. The results show that adding emotions to the prediction process can cause predictions to shift upward, and imply that adding emotions to price predictions can be a false choice for real-world trading.en
dc.description.provenanceMade available in DSpace on 2023-03-19T22:04:47Z (GMT). No. of bitstreams: 1
U0001-2906202215320400.pdf: 2132900 bytes, checksum: 6058ef2f689e41ab5084e5f26bbb4da5 (MD5)
Previous issue date: 2022
en
dc.description.tableofcontentsTable of contents V Introduction 1 1.1 Background and motivation 1 1.1.1 Efficient market hypothesis (EMH) and its insufficiency 1 1.1.2 Behavioral economics 1 1.2 Market sentiment 2 1.2.1 The sentiment of investors matters 2 1.2.2 The role of sentiment in the stock market 2 1.2.3 The sentiment of a large Taiwanese chat group 3 1.2.4 Emotion extraction methods and their insufficiency 3 1.2.5 Improving emotion extraction process by using BERT 3 1.3 Market prediction 4 1.3.1 Stock market prediction with machine learning and neural network 4 1.3.2 Predicting with sentiment 4 1.4 Research problem 5 1.5 The contributions of our research 6 1.5.1 Theoretical contribution 6 1.5.2 Methodological contribution 6 CHAPTER 2. Literature Review 7 2.1 Brief overview of the research problem 7 2.1.1 The efficient market hypothesis (EMH) 7 2.1.2 The insufficiency of EMH 8 2.2 Behavioral economics and the noise trader 9 2.2.1 The behavioral economics point of view of the market 9 2.2.2 Noise trader and irrationality 9 2.3 Measuring market emotions 10 2.3.1 Measuring market emotions using sentiment dictionary 10 2.3.2 Measuring market emotions using machine learning 10 2.4 Predicting the market through machine learning 11 2.4.1 Using technical indicators in stock prediction 11 2.4.2 Predicting with technical and emotional indicators 11 2.5 Prediction methods 12 2.5.1 Traditional machine learning 12 2.5.2 Neural network 13 2.5.3 RNN (recurrent neural network) 13 2.5.4 LSTM (long short-term memory) 14 2.5.5 CNN (convolutional neural network) 14 2.5.6 CNN+LSTM model to predict stock prices 15 2.5.7 BERT (Bidirectional Encoder Representations from Transformers) 15 2.6 Summary 17 CHAPTER 3. Methodology 18 3.1 Working flow and preprocess 18 3.1.1 Brief working flow of the thesis 18 3.1.2 The definitions of our models 19 3.1.3 Process of prediction 19 3.1.4 CKIP tagger (Chinese Knowledge and Information Processing) 24 3.1.5 Text dataset: the chat history of 110,000 members of “Gooaye” chat group 25 3.1.6 Text preprocessing 25 3.1.7 Chinese financial sentiment dictionary 26 3.1.8 Daily stock technical indicators of Taiwanese stock market 28 3.1.9 Sentence length limitation 28 3.1.10 Moving average (MA) 29 3.2 Structure of BERT emotion classifier 29 3.2.1 BERT fine-tuning and classification procedure 30 3.3 The prediction model 33 3.3.1 Inputs and model 33 3.4 Metrics 36 3.4.1 Metrics of the CNN+LSTM model 36 3.4.2 Metrics of the BERT emotion classifier 36 CHAPTER 4. Model Results and Statistical Analysis 38 4.1 The metrics of BERT classifier 38 4.2 The labeled sentence ratio of dictionary and BERT classifier 39 4.3 The graph of predicted prices 40 4.3.1 Descriptive statistics of price differences 43 4.4 The performance of price prediction 44 4.5 Statistical analysis of price differences 48 4.5.1 ANOVA on the price differences of moving averages 48 4.5.2 ANOVA on the price differences of minimum text lengths 51 4.6 Summary 52 CHAPTER 5. Conclusions 54 5.1 The conceptual contribution 54 5.1.1 The RMSE of predicted prices 54 5.1.2 The emotional shifts in the results 54 5.2 The methodological contribution 55 5.2.1 The performance of BERT emotion classifier 55 5.2.2 The predicted prices from different models 55 5.3 The conclusion of the thesis 56 5.3.1 Future work 56 Reference List 57 List of tables Table 3.1 Examples of filtered sentences 21 Table 3.2 An example of stock indicators 21 Table 3.3 An example of moving average preprocess 29 Table 3.4 The parameters of BERT emotion classifier model 30 Table 3.5 Examples of classified sentences 32 Table 3.6 The parameters of prediction model 34 Table 4.1 Performance of BERT emotion classifier with 80% training and 20% testing 38 Table 4.2 Performance of BERT emotion classifier with 90% training and 10% testing 38 Table 4.3 The ratios and numbers of all sentences 39 Table 4.4 The ratios and numbers of labeled sentences 39 Table 4.5 Descriptive statistics of price differences 43 Table 4.6 RMSE of technical indicator only model 45 Table 4.7 RMSE of dictionary and self-labeled emotion model 45 Table 4.8 ANOVA on models and moving averages 50 Table 4.9 ANOVA on models and text lengths 52
dc.language.isoen
dc.subject市場情緒zh_TW
dc.subject效率市場假說zh_TW
dc.subject非理性交易者zh_TW
dc.subject情感分析zh_TW
dc.subjectBERTzh_TW
dc.subjectAIzh_TW
dc.subjectNoise traderen
dc.subjectBERTen
dc.subjectAIen
dc.subjectEfficient and inefficient marketen
dc.subjectSentimental analysisen
dc.subjectEmotion of the marketen
dc.title情緒指標與台灣股市短期震盪之預測zh_TW
dc.titleIncorporating emotion indicators to predict short-term Taiwanese stock fluctuationsen
dc.typeThesis
dc.date.schoolyear110-2
dc.description.degree碩士
dc.contributor.oralexamcommittee張瑋倫(Wei-Lun Chang),黃意婷(Yi-Ting Huang)
dc.subject.keywordAI,BERT,情感分析,非理性交易者,效率市場假說,市場情緒,zh_TW
dc.subject.keywordAI,BERT,Sentimental analysis,Noise trader,Efficient and inefficient market,Emotion of the market,en
dc.relation.page64
dc.identifier.doi10.6342/NTU202201204
dc.rights.note同意授權(限校園內公開)
dc.date.accepted2022-07-19
dc.contributor.author-college管理學院zh_TW
dc.contributor.author-dept資訊管理學研究所zh_TW
dc.date.embargo-lift2022-08-05-
顯示於系所單位:資訊管理學系

文件中的檔案:
檔案 大小格式 
U0001-2906202215320400.pdf
授權僅限NTU校內IP使用(校園外請利用VPN校外連線服務)
2.08 MBAdobe PDF
顯示文件簡單紀錄


系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。

社群連結
聯絡資訊
10617臺北市大安區羅斯福路四段1號
No.1 Sec.4, Roosevelt Rd., Taipei, Taiwan, R.O.C. 106
Tel: (02)33662353
Email: ntuetds@ntu.edu.tw
意見箱
相關連結
館藏目錄
國內圖書館整合查詢 MetaCat
臺大學術典藏 NTU Scholars
臺大圖書館數位典藏館
本站聲明
© NTU Library All Rights Reserved