請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/80007完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 陳彥仰(Mike Y. Chen) | |
| dc.contributor.author | Yu-Hsin Lin | en |
| dc.contributor.author | 林雨新 | zh_TW |
| dc.date.accessioned | 2022-11-23T09:20:46Z | - |
| dc.date.available | 2021-08-06 | |
| dc.date.available | 2022-11-23T09:20:46Z | - |
| dc.date.copyright | 2021-08-06 | |
| dc.date.issued | 2021 | |
| dc.date.submitted | 2021-07-20 | |
| dc.identifier.citation | [1] Anonymous. Ds4-bt - ps4 developer wiki, 2020. [2] C. Attig, N. Rauh, T. Franke, and J. F. Krems. System latency guidelines then and now – is zero latency really considered necessary? In D. Harris, editor, Engineering Psychology and Cognitive Ergonomics: Cognition and Design, pages 3–14, Cham,2017. Springer International Publishing. [3] bHaptics. bhaptics audio-to-haptic, 2020 [4] bHaptics. bhaptics tactsuit, 2020. [5] A. Bochkovskiy, C.-Y. Wang, and H.-Y. M. Liao. Yolov4: Optimal speed and accuracy of object detection, 2020. [6] M. Channell. The 20 best driving games of the last decade: 101. https://www.topgear.com/car-news/electric/20-best-driving-games-last-decade-10-1, 2020. [7] M. Channell. The 20 best driving games of the last decade: 2011. https://www.topgear.com/car-news/electric/20-best-driving-games-last-decade-20-11, 2020. [8] D. K. Chen, J.-B. Chossat, and P. B. Shull. Haptivec: Presenting haptic feedback vectors in handheld controllers using embedded tactile pin arrays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI ’19, page 1– 11, New York, NY, USA, 2019. Association for Computing Machinery. [9] A. Cuzzocrea. Synopsis data structures for representing, querying, and mining data streams. In Handbook of Research on Innovations in Database Technologies and Applications: Current and Future Trends, pages 701–715. IGI Global, Pennsylvania, USA, 2009. [10] P. T. Eugster, P. A. Felber, R. Guerraoui, and A.M. Kermarrec. The many faces of publish/subscribe. ACM Comput. Surv., 35(2):114– 131, June 2003. [11] ForceTubeVR. Forcetubevr documentation, 2020. [12] S. H. GamesRadar Staff. The 25 best fps games of all time. https://www.gamesradar.com/best-fps-games/, June 2020. [13] T. Kaaresoja, S. Brewster, and V. Lantz. Towards the temporally perfect virtual button: Touch-feedback simultaneity and perceived quality in mobile touchscreen press interactions. ACM Trans. Appl. Percept., 11(2), June 2014. [14] H. Kajiyama, A. Inoue, and T. Hoshi. Shapio: Shape i/o controller for video games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, CHI PLAY ’15, page 565– 570, New York, NY, USA, 2015. Association for Computing Machinery [15] S.-H. Liu, P.-C. Yen, Y.-H. Mao, Y.-H. Lin, E. Chandra, and M. Y. Chen. Headblaster: A wearable approach to simulating motion perception using head-mounted air propulsion jets. ACM Trans. Graph., 39(4), jul 2020. [16] Logitech. Logitech g920 g29 driving force steering wheels pedals, 2015. [17] G. Mirone. Multibody elastic simulation of a gokart: Correlation between frame stiffness and dynamic performance. International Journal of Automotive Technology, 11(4):461–469, 2010. [18] J. Nielsen. Usability engineering. Morgan Kaufmann an imprint of Academic Press, a Harcourt Science and Technology Company, Burlington, Massachusetts, 1993. [19] M. Puckette. Pure data. In Proceedings of the second intercollege computer music concerts, pages 37–41, Tachikawa, Japan, 01 1996. Self-published. [20] F. Richter. The most important gaming platforms in 2019, 2019. [21] SimRacingStudio. Sim racing studio, 2020. [22] F. C. S.L. Flaticon, the largest database of free vector icons, 2020. [23] R. Smith. An overview of the tesseract ocr engine. In Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), volume 2, pages 629–633, Parana, Brazil, Sept. 2007. IEEE. [24] M. Software. Car physics for games, 2003. [25] Valve. Steam hardware and software survey, 2020. [26] Xbox. Xbox wireless controller, 2016. [27] T. Yeh, T-.H. Chang, and R. C. Miller. Sikuli: Using gui screenshots for search and automation. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, UIST ’09, page 183– 192, New York, NY, USA, 2009. Association for Computing Machinery. [28] K. Łopatka, J. Kotus, and A. Czyżewski. Detection, classification and localization of acoustic events in the presence of background noise for acoustic surveillance of hazardous situations. Multimedia Tools and Applications, 429, 12 2015. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/80007 | - |
| dc.description.abstract | 觸覺回饋能顯著地提升虛擬世界中的體驗，然而因大多數高品質的電子遊戲皆為封閉原始碼，修改原始碼以新增觸覺回饋並不實際。為此我們開發了電玩觸覺回饋事件之多頻道黑箱即時偵測平台(HapticSeer)，其設計基於以下兩個重要洞見：（1）所有電子遊戲中的影像、聲音與控制器訊號，均可被及時分析以偵測遊戲事件（2）僅需數種事件偵測器就能套用至多數遊戲中相似的使用者介面。我們實作了數個電腦與虛擬實境遊戲的及時事件偵測器，以驗證其即時性與正確性。我們並招募了數個觸覺回饋裝置開發者，使用HapticSeer將自製與市售的觸覺回饋裝置整合至市售電子遊戲，蒐集與分析開發者的回饋。 | zh_TW |
| dc.description.provenance | Made available in DSpace on 2022-11-23T09:20:46Z (GMT). No. of bitstreams: 1 U0001-1907202121221800.pdf: 3892227 bytes, checksum: 9aa9a8bd742ddbadc212503efec339ca (MD5) Previous issue date: 2021 | en |
| dc.description.tableofcontents | 誌謝 ii 摘要 iii Abstract iv 1 Introduction 1 2 Related Work 4 2.1 Explicit API Approach 4 2.1.1 Haptic Device API for Games 4 2.1.2 API Exported from Games 5 2.2 Black-box Approach 5 2.2.1 Using Visual Channel 5 2.2.2 Using Audio channel 6 2.2.3 Using Controller I/O channel 6 3 Approach 7 3.1 Data Streams 7 3.2 Design Patterns 8 3.3 Latency Threshold Requirement 10 4 System Design 11 4.1 Message Broker 11 4.2 Components 12 4.2.1 Raw Data Capturers 12 4.2.2 Feature Extractor 12 4.2.3 Event Detectors 13 4.2.4 Launcher 13 5 Implementation 14 5.1 DirectX Capturer 14 5.1.1 Capture Method 15 5.1.2 Capture Latency 15 5.2 WASAPI Capturer 15 5.2.1 Capture Method 16 5.2.2 Time Window 16 5.2.3 Capture Latency 16 5.3 Controller I/O Capturers 17 5.3.1 Capture Method 17 5.3.2 Capture Latency 17 5.4 Feature Extractors 18 5.4.1 Optical Character Recognition Number Extractor 18 5.4.2 Health Bar Extractor 19 5.4.3 Damage Indicator Extractor 19 5.4.4 Pulse Extractor 20 5.5 Event Detectors 20 5.5.1 Gunfire Detector 21 5.5.2 Player Hit Detector 21 5.5.3 Inertia Detector 22 5.6 End-to-end System Correctness 23 5.6.1 Approach 1: Visual Channel Only 23 5.6.2 Approach 2: Audio Channel Only 23 5.7 Detection Results 24 5.7.1 Case 1: Half-Life: Alyx 25 5.7.2 Case 2: Project CARS 2 25 5.8 System Latency 26 5.8.1 Feature Extractor Latency 27 5.8.2 Transmission Latency in Redis 27 5.8.3 Event Detection Latency 27 5.8.4 Endtoend Latency 28 6 Developer Feedback 29 6.1 Apparatus 29 6.2 Participants 30 6.3 Feedback Summary 31 6.3.1 Time to Complete 31 6.3.2 Easiness to Learn 32 6.3.3 Effectiveness 32 6.3.4 Latency 32 6.3.5 Satisfaction 33 7 Discussion and Limitations 34 7.1 Scripted Experience 34 7.2 Fine-grained Haptics 34 7.3 Console Game 35 8 Future Work 36 8.1 Graphical User Interface 36 8.2 Open Platform 36 8.3 Custom Controller Input Analysis 37 Bibliography 38 Icon Credits 41 | |
| dc.language.iso | en | |
| dc.subject | 體感回饋 | zh_TW |
| dc.subject | 資訊系統 | zh_TW |
| dc.subject | 電子遊戲 | zh_TW |
| dc.subject | 程式開發輔助 | zh_TW |
| dc.subject | Artifact or System | en |
| dc.subject | Games/Play | en |
| dc.subject | Programming/Development Support | en |
| dc.subject | Touch/Haptic/Pointing/Gesture | en |
| dc.title | 電玩觸覺回饋事件之多頻道黑箱即時偵測平台 | zh_TW |
| dc.title | "HapticSeer: A Multi-channel, Black-box, Platform-agnostic Approach to Detecting Video Game Events for Real-time Haptic Feedback" | en |
| dc.date.schoolyear | 109-2 | |
| dc.description.degree | 碩士 | |
| dc.contributor.author-orcid | 0000-0003-4384-7191 | |
| dc.contributor.oralexamcommittee | 鄭龍磻(Hsin-Tsai Liu),陳炳宇(Chih-Yang Tseng),蔡欣叡,張永儒 | |
| dc.subject.keyword | 電子遊戲,程式開發輔助,體感回饋,資訊系統, | zh_TW |
| dc.subject.keyword | Games/Play,Programming/Development Support,Touch/Haptic/Pointing/Gesture,Artifact or System, | en |
| dc.relation.page | 41 | |
| dc.identifier.doi | 10.6342/NTU202101577 | |
| dc.rights.note | 同意授權(全球公開) | |
| dc.date.accepted | 2021-07-20 | |
| dc.contributor.author-college | 電機資訊學院 | zh_TW |
| dc.contributor.author-dept | 資訊網路與多媒體研究所 | zh_TW |
| 顯示於系所單位： | 資訊網路與多媒體研究所 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| U0001-1907202121221800.pdf | 3.8 MB | Adobe PDF | 檢視/開啟 |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。