Skip navigation

DSpace

機構典藏 DSpace 系統致力於保存各式數位資料(如:文字、圖片、PDF)並使其易於取用。

點此認識 DSpace
DSpace logo
English
中文
  • 瀏覽論文
    • 校院系所
    • 出版年
    • 作者
    • 標題
    • 關鍵字
  • 搜尋 TDR
  • 授權 Q&A
    • 我的頁面
    • 接受 E-mail 通知
    • 編輯個人資料
  1. NTU Theses and Dissertations Repository
  2. 電機資訊學院
  3. 電機工程學系
請用此 Handle URI 來引用此文件: http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/51007
完整後設資料紀錄
DC 欄位值語言
dc.contributor.advisor黃寶儀
dc.contributor.authorYu-Chuan Yenen
dc.contributor.author顏于娟zh_TW
dc.date.accessioned2021-06-15T13:23:47Z-
dc.date.available2016-07-04
dc.date.copyright2016-07-04
dc.date.issued2016
dc.date.submitted2016-06-24
dc.identifier.citation[1] R. Beuran, M. Ivanovici, and B. Dobinson, “Network quality of service measurement system for application requirements evaluation,” in Proc. IEEE SPECTS, 2003, pp. 380–387.
[2] ITU-T Recommendation P.10/G.100. Vocabulary for performance and quality of service. ITU, 2006.
[3] Z. Yan, Q. Liu, T. Zhang, and C. W. Chen. “Exploring QoE for Power Efficiency: A Field Study on Mobile Videos with LCD Displays.” In Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, pages 431--440. ACM, 2015.
[4] Ricky K. P. Mok , Xiapu Luo , Edmond W. W. Chan , Rocky K. C. Chang, “QDASH: a QoE-aware DASH system”, Proceedings of the 3rd Multimedia Systems Conference, February 22-24, 2012, Chapel Hill, North Carolina
[5] P. Reichl, S. Egger, R. Schatz, and A. DAlconzo. “The logarithmic nature of QoE and the role of the Weber- Fechner Law in QoE assessment”. In Proc. of ICC’10, 2010.
[6] M. Fiedler, T. Hossfeld, and P. Tran-Gia. “A generic quantitative relationship between Quality of Experience and Quality of Service”. IEEE Network, vol. 24(2), pp.36-41, 2010.
[7] ITU-T Recommendation P.862. Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs. ITU, 2001.
[8] ITU, 'Perceptual objective listening quality assessment,' Int. Telecomm. Union, Geneva, Switzerland, ITU-T Rec. P.863, 2011.
[9] A.S. Alzahrani and M.E. Woodward, 'End-to-End Delay in Localized QoS Routing,' Proc. IEEE Int',l Conf. Comm. Systems (ICCS), pp. 1700-1706, 2008.
[10] J. Montes, B. Nicolae, G. Antoniu, A. Sánchez, and M. S. Pérez, 'Using global behavior modeling to improve qos in cloud data storage services,' in Proc. of the 2010 IEEE 2nd Int. Conf. on Cloud Computing Technology and Science, CLOUDCOM '10, pages 304-311, Washington, DC, USA, 2010.
[11] K. U. R. Laghari, N. Crespi, and K. Connelly, “Toward Total Quality of Experience: A QoE Model in a Communication Ecosystem,” IEEE Commun. Mag., vol. 50, no. 4, Apr. 2012, pp. 58–65.
[12] Martínez-Pérez, B., de la Torre-Díez, I., Candelas-Plasencia, S., López-Coronado, M., Development and evaluation of tools for measuring the Quality of Experience (QoE) in mHealth applications. J. Med. Syst. 37(5): 1–8, 2013.
[13] K. Wolter and A. Moorsel, 'The Relationship between Quality of Service and Business Metrics: Monitoring, Notification and Optimization', Hewlett-Packard Labs Technical Report HPL-2001-96, 2001
[14] L. Zhou, J. J. Rodrigues and L. M. Oliveira, 'QoE-driven power scheduling in smart grid: Architecture, strategy, methodology', IEEE Commun. Mag., vol. 50, no. 5, pp. 136-141, 2012
[15] T. Hossfeld, 'Quantification of YouTube QoE via Crowdsourcing', Proc. IEEE MQoE 2011
[16] ITU-T, “Methods for subjective determination of transmission quality, ” ITU-T recommendation P.800, 1996.
[17] P. Wuttidittachotti and T. Daengsi, QoE of Social Network Applications: A Study of VoIP Quality from Skype vs LINE over 3G and 4G ICUFN 2015
[18] A. Kain and M Macon, 'Spectral Voice Conversion for Text-to-Speech Synthesis', Proc. ICASSP, vol. 1, pp. 285-288
[19] M. Fiedler, T. Hossfeld, and P. Tran-Gia, “A generic quantitative relationship between quality of experience and quality of service,” IEEE Network, vol. 24, no. 2, pp. 36–41, Mar.–Apr. 2010.
[20] T. Wang, A. Pervez, H. Zou, 'VQM-based QoS/QoE Mapping for Streaming Video', Proceedings of the 3rd IEEE International Conference on Broadband Network and Multimedia Technology (IC-BNMT), pp. 807-812, 2010.
[21] Jeff Howe, “The rise of crowdsourcing” 2006
[22] Óscar Figuerola Salas , Velibor Adzic , Akash Shah , Hari Kalva, Assessing internet video quality using crowdsourcing, Proceedings of the 2nd ACM international workshop on Crowdsourcing for multimedia, October 22-22, 2013, Barcelona, Spain
[23] Mason, Winter and Suri, Siddharth, Conducting Behavioral Research on Amazon's Mechanical Turk (October 12, 2010). Behavior Research Methods, Forthcoming. Available at SSRN: http://ssrn.com/abstract=1691163
[24] Yen, Y.-C., Chu, C.-Y., Yeh, S.-L., Chu, H.-H., Huang, P.: Lab experiment vs. crowdsourcing: a comparative user study on skype call quality. In: AINTEC 2013, Bangkok, Thailand (2013)
[25] Thomas Volk, Christian Keimel , Michael Moosmeier , Klaus Diepold , Crowdsourcing vs. laboratory experiments-QoE evaluation of binaural playback in a teleconference scenario, Pages 99-109, Computer Networks: The International Journal of Computer and Telecommunications Networking, October 2015
[26] S. Moller, W.-Y. Chan, N. Cote, T. H. Falk, A. Raake, and M. Walter- mann, “Speech quality estimation: Models and trends,” IEEE Signal Process. Mag., vol. 28, no. 6, pp. 18,28–18,28, Nov. 2011.
[27] ITU-T, “The E-model: A computational model for use in transmission planning,” ITU-T recommendation G.107, 1998.
[28] NASA’s photo organizing project, http://eol.jsc.nasa.gov
[29] Aitamurto, Tanja (May 8, 2015). 'Crowdsourcing as a Knowledge-Search Method in Digital Journalism: Ruptured Ideals and Blended Responsibility'
[30] Prpić, John; Araz TAEIHAGH; and Melton, James, 'Crowdsourcing the Policy Cycle' (2014). Research Collection School of Social Sciences. Paper 1864.
[31] Omar Alonso , Daniel E. Rose , Benjamin Stewart, Crowdsourcing for relevance evaluation, ACM SIGIR Forum, v.42 n.2, December 2008
[32] J. Bolot, 'End-to-end packet delay and loss behavior in the Internet', Proc. ACM SIGCOMM',93
[33] L.Sun, E.C.Ifeachor, 'Subjective and Objective Speech Quality Evaluation under Bursty Losses', In Proc. MESAQIN '02, Prague, Czech Republic.
[34] L. Yamamoto and J.G. Beerends, 'Impact of network performance parameters on the end-to-end perceived speech quality', Expert ATM Traffic Symposium
[35] T. Hoßfeld, P. Tran-Gia, M. Fiedler, 'Quantification of Quality of Experience for Edge-Based Applications', 20th International Teletraffic Congress (ITC20), Ottawa, Canada, June 2007.
[36] Andersen, S., Duric, A., Astrom, H., Hagen, R., Kleijn, W., Linden, J.: Internet Low Bit Rate Codec (iLBC). RFC 3951 (Experimental) (2004)
[37] L. Ding and R. A. Goubran. Assessment of effects of packet loss on speech quality in VoIP. In Proceedings of the 2nd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications, pages 49--54, 2003.
[38] ITU-T Recommendation P.800, Methods for Subjective Determination of Transmission Quality, 1996
[39] G. Paolacci, J. Chandler, P. G. Ipeirotis, Running Experments on Amazon Mechanical Turk, Judgment and Decision Making, Vol. 5, No. 5, 2010
[40] W. Mason, S. Suri, Conducting Behavioral Research on Amazon’s Mechanical Turk, 2010
[41] M. Buhrmester, T. Kwang and S. D. Gosling, Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High- Quality, Data?, Perspectives on Psychological Science, Vol. 6, No. 3, 2011
[42] A. J. Berinsky, G. A. Huber, G.S. Lenz, Evaluating Online Markets for Experimental Research: Amazon.com’s Mechanical Turk, Society for Political Methodology, Oxford University Press, 2012
[43] J. Knobe, Z. G. Szabó, Modals with a Taste of the Deontic, Semantics and Pragmatics, Vol. 6, 2013
[44] F. Ribeiro, D. Florencio, and C. Z. Seltzer, “CROWDMOS: An approach for crowdsourcing mean opinion score studies,” in Proc. IEEE ICASSP, 2011, pp. 2416–2419.
[45] Chen, S., Chu, C. Y., Yeh, S. L., Chu, H. H., & Huang, P. (2014). Modeling the QoE of Rate Changes in SKYPE/SILK VoIP Calls. IEEE/ACM Transactions on Networking (TON), 22(6), 1781-1793
[46] Hoßfeld, T., Hock, D., Tran-Gia, P., Tutschku, K., & Fiedler, M. (2008, May). Testing the IQX Hypothesis for Exponential Interdependency Between QoS and QoE of Voice Codecs iLBC and G. 711. In Proceedings of the 18th ITC Specialist Seminar on Quality of Experience (pp. 105-114)
[47] S. Kraft, U. Zölzer: 'BeaqleJS: HTML5 and JavaScript based Framework for the Subjective Evaluation of Audio Quality', Linux Audio Conference, 2014, Karlsruhe, Germany
[48] A. Takaharhi. 'Opinion Model for Estimating Conversa- tional Quality of VolP.' Proc. IEEE ICASSP '04. vol. Ill, May 2004, pp. 1072-75.
[49] Beerends, J. , Larsen, E. , Lyer, N. , and van Vugt, J. (2004). “Measurement of speech intelligibility based on the PESQ approach,” in Proceedings of the Workshop Measurement of Speech and Audio Quality in Networks (MESAQIN), Prague, Czech Republic.
[50] R. Pichevar, J. Wung, D. Giacobello and J. Atkins, 'Design and Optimization of a Speech Recognition Front-end for Distant-Talking Control of a Music Playback Device', 2014
[51] ITU-T Recommendation J.247, “Objective perceptual multimedia video quality measurement in the presence of a full reference,” Aug. 2008.
[52] ITU-T Recommendation J.144, “Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference,” Aug. 2008.
[53] ITU-T Recommendation J.246, “Perceptual audiovisual quality measurement techniques for multimedia services over digital cable television networks in the presence of a reduced bandwidth reference,”Aug.2008.
[54] T. Yamada, Y. Miyamoto, Y. Senda, and M. Serizawa, “Video- Quality Estimation Based on Reduced-Reference Model Employing Activity-Difference,” IEICE Trans. on Fundamentals, vol. E92-A, no. 12, pp. 3284-3290, Dec. 2009.
[55] István Ketykó , Katrien De Moor , Toon De Pessemier , Adrián Juan Verdejo , Kris Vanhecke , Wout Joseph , Luc Martens , Lieven De Marez, QoE measurement of mobile YouTube video streaming, Proceedings of the 3rd workshop on Mobile video delivery, October 25-25, 2010, Firenze, Italy
[56] Taichi Kawano, Kazuhisa Yamagishi,' No Reference Video Quality Assessment Model for Video Streaming Services,' IEEE, PV, 2010
[57] Tobias Hoßfeld , Sebastian Biedermann , Raimund Schatz , Alexander Platzer , Sebastian Egger , Markus Fiedler, The memory effect and its implications on web QoE modeling, Proceedings of the 23rd International Teletraffic Congress, September 06-09, 2011, San Francisco, California
dc.identifier.urihttp://tdr.lib.ntu.edu.tw/jspui/handle/123456789/51007-
dc.description.abstract如何滿足使用者一直是應用軟體服務商必須面對的課題,而對於任何的服務商而言都必須了解使用者對於所提供之服務的滿意程度,以避免使用者因為不滿意的使用經驗而拒絕再次使用服務。在網路語音的範疇內,Skype可以說是目前最受歡迎的網路語音服務,同理應當瞭解其顧客對於Skype提供的網路語音品質的滿意程度。在可影響通話品質的因素之中,封包遺失無疑地對於即時網路語音的感受品質而言有著重大的影響,然而,針對封包遺失的感受品質影響卻甚少被討論,相關的使用者經驗模型也尚未被提出。已存在並廣泛運用的客觀感受模型POLQA,因其設計的限制並不適用於即時資料的傳輸,也因此若Skype想要預測其使用者對於服務的滿意程度,必須建立替代的使用者經驗模型才能達到目標。在此次研究中,我們模擬多種封包遺失狀況的Skype語音,並且在crowdsourcing平台請超過3000位受測者對各個模擬的Skype語音品質評分,經過分析可測量之網路品質指標(包含位元率、封包遺失率以及平均的單次封包遺失個數)與使用者經驗的關係,我們建立了一個以使用者經驗導向的模型,其適配程度(goodness of fit)為94.28%,在預測其他2獨立資料組分別得到92.16%和89%的適配程度,且這個模型與POLQA的預測比較之下,我們提出的使用者模型預測較POLQA更為精準。zh_TW
dc.description.abstractSatisfying users has been an important issue for all application service providers, and all service providers shall understand how their users react to the services they provide. For real-time speech delivery services such as the most popular voice over IP (VoIP) service, Skype, packet loss is one of the major impairment to user satisfaction. However, there still lacks investigation and model of how users perceive the quality of speech with different packet loss conditions for Skype calls. A well-known perceptual objective model POLQA (Perceptual Objective Listening Quality Assessment) has its limitation to measure user experience for real-time data transmission, and hence, an alternative parametric model should be constructed for VoIP calls. Motivated by the existing model deficiency and lack of research concerning packet loss conditions, this study conducts a large-scale subjective experiment with more than 3000 participants involved on crowdsourcing platform to rate the perceived quality under different packet loss schemes. In the end, we propose a quality of experience (QoE) model with respect to measurable quality of service (QoS) parameters that are the indicators of network system performance including bitrate, loss rate and average burst length. The result shows that the goodness of fit of our proposed model is 94.28%, and we test the goodness of fit with 2 more independent datasets that obtain the goodness of fit being 92.16% and 89%, respectively. As our proposed model is compared to the POLQA, the proposed model outperforms POLQA modeling the perceived quality of Skype calls.en
dc.description.provenanceMade available in DSpace on 2021-06-15T13:23:47Z (GMT). No. of bitstreams: 1
ntu-105-R03921030-1.pdf: 2473517 bytes, checksum: 8e8c058e7a60860f82b2d0930d94a796 (MD5)
Previous issue date: 2016
en
dc.description.tableofcontents口試委員會審定書 #
誌謝 i
中文摘要 ii
ABSTRACT iii
CONTENTS v
List of Figures ix
List of Tables x
Chapter 1 Introduction 1
Chapter 2 Related Work 9
2.1 Quality of Service (QoS) and Quality of Experience (QoE) 10
2.1.1 Quality of Service (QoS) 10
2.1.2 Quality of Experience (QoE) 11
2.1.3 QoS and QoE Quantitative Relationship 12
2.1.4 Existing QoE Models 13
2.2 Crowdsourcing 17
2.2.1 Definition and Advantages 17
2.2.2 Controversial Issues 18
2.3 Audio Quality Assessment Models 20
2.3.1 Packet Loss 20
2.3.2 PESQ, POLQA and E-model 21
Chapter 3 Preliminary Experiment 24
Experiment Design 25
3.1 Experiment Result 33
3.2 Observation 39
3.3 LossStd 40
Chapter 4 Large-scale Experiment 44
4.1 Experiment Design 44
4.2 Experiment Result 54
4.2.1 MOS Distribution 55
4.2.2 ANOVA 58
4.2.3 Modeling 59
4.2.3.1 Modeling Bitrate 59
4.2.3.2 Modeling Loss Rate 63
4.2.3.3 Modeling Average Burst Length 66
4.2.3.4 Modeling LossStd 70
4.2.3.5 Final Model 74
4.2.4 Discussion of one parameter model function 76
4.2.5 Factor Relationship 79
4.2.5.1 Relationship Between Bitrate and MOS 79
4.2.5.2 Relationship Between Loss Rate and MOS 81
4.2.5.3 Relationship Between Average Burst Length and MOS 82
4.2.6 Justify Preliminary Result 86
4.2.7 Machine Learning Approach 87
4.2.7.1 Random Forest 88
4.2.7.2 Goodness of fit 89
4.2.8 Discussion of Impacts of Sampling Method on Modeling 90
4.2.8.1 Number of Sample Points 90
4.2.8.2 Sample Point Distribution 93
4.2.9 Extended Discussion of LossStd 96
4.2.9.1 General Discussion 97
4.2.9.2 Classification and Regression Tree 100
Chapter 5 Model Comparison 105
5.1 Model Comparison with 215-track Dataset 106
5.2 Model Comparison with 381-track dataset 109
Chapter 6 Conclusion 113
Reference 118
dc.language.isoen
dc.title針對 Skype/SILK 網路語音封包遺失造成影響之使用者經驗導向的模型建立zh_TW
dc.titleA QoE-Centric Modeling of End-to-End Packet Loss Impact in Skype/SILK Call Qualityen
dc.typeThesis
dc.date.schoolyear104-2
dc.description.degree碩士
dc.contributor.oralexamcommittee陳宏銘,朱浩華,葉素玲
dc.subject.keywordPOLQA,Skype,服務品質,用戶體驗品質,crowdsourcing,封包遺失,zh_TW
dc.subject.keywordQoS,QoE,Skype,crowdsourcing,packet loss,POLQA,en
dc.relation.page127
dc.identifier.doi10.6342/NTU201600461
dc.rights.note有償授權
dc.date.accepted2016-06-24
dc.contributor.author-college電機資訊學院zh_TW
dc.contributor.author-dept電機工程學研究所zh_TW
顯示於系所單位:電機工程學系

文件中的檔案:
檔案 大小格式 
ntu-105-1.pdf
  目前未授權公開取用
2.42 MBAdobe PDF
顯示文件簡單紀錄


系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。

社群連結
聯絡資訊
10617臺北市大安區羅斯福路四段1號
No.1 Sec.4, Roosevelt Rd., Taipei, Taiwan, R.O.C. 106
Tel: (02)33662353
Email: ntuetds@ntu.edu.tw
意見箱
相關連結
館藏目錄
國內圖書館整合查詢 MetaCat
臺大學術典藏 NTU Scholars
臺大圖書館數位典藏館
本站聲明
© NTU Library All Rights Reserved