請用此 Handle URI 來引用此文件：
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/65535完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 陳炳宇 | |
| dc.contributor.author | Yu-Hsin Lin | en |
| dc.contributor.author | 林玉芯 | zh_TW |
| dc.date.accessioned | 2021-06-16T23:49:01Z | - |
| dc.date.available | 2015-08-10 | |
| dc.date.copyright | 2012-08-10 | |
| dc.date.issued | 2012 | |
| dc.date.submitted | 2012-07-22 | |
| dc.identifier.citation | [1] I. Arai, S. Horimi, and N. Nishi. Wi-Foto2: Heterogeneous device controller using Wi-Fi positioning and template matching. In Demos of the 2010 International Conference on Pervasive Computing, pages 70–73, 2010.
[2] Y. Ayatsuka, S.Matsuoka, and J. Rekimoto. Penumbrae for 3D interactions. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, pages 165–166, 1996. [3] R. Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355–385, 1997. [4] R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre. Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21(6):34–47, 2001. [5] M. Bajura, H. Fuchs, and R. Ohbuchi. Merging virtual objects with the real world: seeing ultrasound imagery within the patient. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, pages 203–210, 1992. [6] J. Bastian, B. Ward, R. Hill, A. van den Hengel, and A. Dick. Interactive modeling for AR applications. In Proceedings of the 9th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 199–205, 2010. [7] P. Besl and N. McKay. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239–256. [8] M. Billinghurst, D. Belcher, A. Gupta, and K. Kiyokawa. Communication behaviors in colocated collaborative ar interfaces. International Journal of Human-Computer Interaction, 16:395–423, 2003. [9] M. Billinghurst, S.Weghorst, and T. Furness. Shared space: An augmented reality approach for computer supported collaborative work. Virtual Reality, 3(1):25–36, 1998. [10] R. Bolt. Put-that-there: Voice and gesture at the graphics interface. In Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques, pages 262–270, 1980. [11] D. A. Bowman and L. F. Hodges. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the 1997 ACM Symposium on Interactive 3D Graphics, pages 35–38, 1997. [12] P. Bunnun and W. Mayol-Cuevas. OutlinAR: An assisted interactive model building system with reduced computational effort. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 61–64, 2008. [13] J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, and M. Ivkovic. Augmented reality technologies, systems and applications. Multimedia Tools and Applications, 51(1):341–377, 2011. [14] T. Caudell. Augmented reality: an application of heads-up display technology. In Proceedings of the Twenty-Fifth IEEE Hawaii International Conference on System Sciences, pages 659–669, 1992. [15] T. Caudell and D. Mizell. Augmented reality: an application of heads-up display technology to manual manufacturing processes. In Proceedings of the Twenty-Fifth IEEE Hawaii International Conference on System Sciences, pages 659–669, 1992. [16] K.-Y. Cheng, Y.-H. Lin, Y.-H. Lin, B.-Y. Chen, and T. Igarashi. Grab-carry-release: Manipulating physical objects in a real scene through a smart phone. In SIGGRAPH Asia 2011 Emerging Technologies, pages 13:1–13:1, 2011. [17] Y. Cui, S. Schuon, D. Chan, S. Thrun, and C. Theobalt. 3D shape scanning with a timeof-flight camera. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 1173–1180, 2010. [18] Y. Cui and D. Stricker. 3D shape scanning with a kinect. In ACM SIGGRAPH 2011 Posters, pages 57:1–57:1, 2011. [19] B. Curless and M. Levoy. A volumetric method for building complex models from range images. In Proceedings of the 23rd ACM Annual Conference on Computer Graphics and Interactive Techniques, pages 303–312, 1996. [20] S. Feiner, B. Macintyre, and D. Seligmann. Knowledge-based augmented reality. Communications of the ACM - Special Issue on Computer Augmented Environments: Back to the Real World, 36(7):53–62, 1993. [21] M. Fiorentino, R. de Amicis, G. Monno, and A. Stork. Spacedesign: A mixed reality workspace for aesthetic industrial design. In Proceedings of the 1st IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 86–, 2002. [22] R. Freeman and A. Steed. Interactive modelling and tracking for mixed and augmented reality. In Proceedings of the 2006 ACM Symposium on Virtual Reality Software and Technology, pages 61–64, 2006. [23] T. Ha and W. Woo. ARwand: Phone-based 3D object manipulation in augmented reality environment. International Symposium on Ubiquitous Virtual Reality, pages 44–47, 2011. [24] N. Hagbi, R. Grasset, O. Bergig, M. Billinghurst, and J. El-Sana. In-place sketching for content authoring in augmented reality games. In Proceedings of the 2010 IEEE Virtual Reality Conference, pages 91–94, 2010. [25] A. Hartl, L. Gruber, C. Arth, S. Hauswiesner, and D. Schmalstieg. Rapid reconstruction of small objects on mobile phones. In Proceedings of the 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pages 20–27, 2011. [26] P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox. RGB-D mapping: Using depth cameras for dense 3d modeling of indoor environments. In Proceedings of the 12th International Symposium on Experimental Robotics, pages 647–663, 2010. [27] A. Henrysson and M. Billinghurst. Using a mobile phone for 6 dof mesh editing. In Proceedings of the 8th ACM SIGCHI New Zealand Chapter’s International Conference on Computer-human Interaction: Design Centered HCI, pages 9–16, 2007. [28] A. Henrysson, M. Billinghurst, and M. Ollila. Virtual object manipulation using a mobile phone. In Proceedings of the 2005 International Conference on Augmented Tele-existence, pages 164–171, 2005. [29] E. Herbst, P. Henry, X. Ren, and D. Fox. Toward object discovery and modeling via 3-d scene comparison. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, pages 2623 –2629, 2011. [30] K. Ishii, Y. Takeoka, M. Inami, and T. Igarashi. Drag-and-Drop interface for registration free object delivery. In Proceedings of the 2010 IEEE International Symposium in Robot and Human Interactive Communication, pages 228–233, 2010. [31] S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon. KinectFusion: Real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 8th Annual ACM Symposium on User Interface and Software Technology, pages 559–568, 2011. [32] H. Kato, M. Billinghurst, I. Poupyrev, K. Imamoto, and K. Tachibana. Virtual object manipulation on a table-top AR environment. In Proceedings of the 2000 IEEE/ACM International Symposium on Augmented Reality, 2000. [33] G. Klein and D. Murray. Parallel tracking and mapping for small AR workspaces. In Proceedings of the 6th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 1–10, 2007. [34] J. Lee, G. Hirota, and A. State. Modeling real objects using video see-through augmented reality. Presence: Teleoperators and Virtual Environments, 11(2):144–157, 2002. [35] S. Lieberknecht, A. Huber, S. Ilic, and S. Benhimane. Rgb-d camera-based parallel tracking and meshing. In Proceedings of the 10th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 147–155, 2011. [36] P. Milgram and F. Kishino. A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, E77-D(12), 1994. [37] M. Mohring, C. Lessig, and O. Bimber. Video see-through AR on consumer cell-phones. In Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 252–253, 2004. [38] R. Newcombe and A. Davison. Live dense reconstruction with a single moving camera. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition, pages 1498–1505, 2010. [39] R. Newcombe, S. Lovegrove, and A. Davison. DTAM: Dense tracking and mapping in realtime. In Proceedings of the 2011 IEEE International Conference on Computer Vision, pages 2320–2327, 2011. [40] Q. Pan, G. Reitmayr, E. Rosten, and T. Drummond. Rapid 3D modelling from live video. In Proceedings of the 33rd IEEE International Convention MIPRO, pages 252–257, 2010. [41] G. Papagiannakis, G. Singh, and N. Magnenat-Thalmann. A survey of mobile and wireless technologies for augmented reality systems. Computer Animation and Virtual Worlds, 19(1):3–22, 2008. [42] W. Piekarski and B. H. Thomas. Interactive augmented reality techniques for construction at a distance of 3D geometry. In Proceedings of the 2003 Workshop on Virtual Environments, pages 19–28, 2003. [43] I. Poupyrev, M. Billinghurst, S.Weghorst, and T. Ichikawa. The go-go interaction technique: Non-linear mapping for direct manipulation in VR. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, pages 79–80, 1996. [44] T. Pyssysalo, T. Repo, T. Turunen, T. Lankila, and J.Roning. CyPhone—bringing augmented reality to next generation mobile phones. In Proceedings of DARE 2000 on Designing Augmented Reality Environments, pages 11–21, 2000. [45] D. Rao, Q. Le, T. Phoka, M. Quigley, A. Sudsang, and A. Ng. Grasping novel objects with depth segmentation. In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2578–2585, 2010. [46] H. Regenbrecht and M. Wagner. Interaction in a collaborative augmented reality environment. In CHI ’02 Extended Abstracts on Human Factors in Computing Systems, pages 504–505, 2002. [47] J. Rekimoto. Transvision: A hand-held augmented reality system for collaborative design. In Proceedings of the Virtual Systems and Multi-Media, pages 85–90, 1996. [48] J. Rekimoto and K. Nagao. The world through the computer: computer augmented interaction with real world environments. In Proceedings of the 8th annual ACM Symposium on User Interface and Software Technology, pages 29–36, 1995. [49] P. Renevier and L. Nigay. Mobile collaborative augmented reality: the augmented stroll. In Proceedings of the Engineering for Human-Computer Interaction, pages 299–316. 2001. [50] G. G. Robertson and S. K. Card. Fix and float: Object movement by egocentric navigation. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology, pages 149–150, 1997. [51] D. Schmalstieg, T. Langlotz, and M. Billinghurst. Augmented reality 2.0. In Virtual Realities, volume 33, pages 13–37. Springer Vienna, 2011. [52] T. Seifried, M. Haller, S. Scott, F. Perteneder, C. Rendl, D. Sakamoto, and M. Inami. CRISTAL: A collaborative home media and device controller based on a multi-touch display. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pages 33–40, 2009. [53] F. Steinicke and K. Hinrichs. Grab-and-throw metaphor: Adapting desktop-based interaction paradigms to virtual reality. In Proceedings of the IEEE Conference on Virtual Reality, pages 128–131, 2006. [54] I. Sutherland. A head-mounted three dimensional display. International Workshop on Managing Requirements Knowledge, page 757, 1968. [55] G. Suzuki, S. Aoki, T. Iwamoto, D. Maruyama, T. Koda, N. Kohtake, K. Takashio, and H. Tokuda. u-Photo: Interacting with pervasive services using digital still images. In Proceedings of the 2005 International Conference on Pervasive Computing, pages 190–207, 2005. [56] Z. Szalav’ari, D. Schmalstieg, A. Fuhrmann, and M. Gervautz. “Studierstube”: An environment for collaboration in augmented reality. Virtual Reality, 3(1):37–48, 1998. [57] A. Tang, C. Owen, F. Biocca, and W. Mou. Comparative effectiveness of augmented reality in object assembly. In Proceedings of the 2003 ACM International Conference on Human Factors in Computing Systems, pages 73–80, 2003. [58] M. Tani, K. Yamaashi, K. Tanikoshi, M. Futakawa, and S. Tanifuji. Object-oriented video: Interaction with real-world objects through live video. In Proceedings of 1992 ACM Conference on Human Factors in Computing Systems, pages 593–598, 1992. [59] B. Thomas, W. Piekarski, and B. Gunther. Using augmented reality to visualise architecture designs in an outdoor environment. University of Sydney, Australia, 1999. [60] K. Vaiapury, A. Aksay, and E. Izquierdo. GrabcutD: improved grabcut using depth information. In Proceedings of the 2010 ACM Workshop on Surreal Media and Virtual Cloning, pages 57–62, 2010. [61] A. van den Hengel, A. Dick, T. Thorm‥ahlen, B. Ward, and P. Torr. Videotrace: rapid interactive scene modelling from video. In ACM SIGGRAPH 2007 papers, 2007. [62] D. van Krevelen and R. Poelman. A survey of augmented reality technologies, applications and limitations. The International Journal of Virtual Reality, 9(2):1–20, 2010. [63] G. Vanderhulst, K. Luyten, and K. Coninx. Photo-based user interfaces: Picture it, tag it, use it. In Proceedings of the 2009 Confederated International Workshops and Posters on On the Move to Meaningful Internet Systems, pages 610–615, 2009. [64] G. Vanderhulst, K. Luyten, and K. Coninx. Pervasive maps: Explore and interact with pervasive environments. In Proceeding of the 2010 IEEE International Conference on Pervasive Computing and Communications, pages 227–234, 2010. [65] D. Wagner and D. Schmalstieg. Handheld augmented reality displays. In Proceedings of the IEEE Conference on Virtual Reality, page 321, 2006. [66] L. C. Wanger, J. A. Ferwerda, and D. P. Greenberg. Perceiving spatial relationships in computer-generated images. IEEE Computer Graphics and Applications, 12(3):44–58, 1992. [67] F. Zhou, H. Duh, and M. Billinghurst. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 193–202, 2008. | |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/65535 | - |
| dc.description.abstract | This paper presents a novel interaction for Handheld Augmented Reality, Grab-Carry-Release, to allow users to communicate visually and experiment with the placement of physical objects in a real scene in situ through smartphones.
In the Grab-Carry-Release process, a user first grabs a physical object on the touchscreen of a smartphone to reconstruct a virtual copy of the object on the fly, then carries it by moving the smartphone, and finally releases it at the target location. To achieve this, a RGB-D camera is attached to the smartphone in order to capture the geometry and appearance of the object simultaneously with a contour tracking and model reconstruction pipeline. The RGB-D camera is also used for locating the reconstructed virtual model with its surrounding physical environment. In addition, possible usage scenarios for in-situ AR interaction and in-situ & remote mobile AR collaboration are developed. Finally, a user study is conducted to gather user feedbacks for future improvement of the proposed interactions. | en |
| dc.description.provenance | Made available in DSpace on 2021-06-16T23:49:01Z (GMT). No. of bitstreams: 1 ntu-101-R99725025-1.pdf: 2759023 bytes, checksum: 6bfe39ac3ffd966441e88a47a2f48414 (MD5) Previous issue date: 2012 | en |
| dc.description.tableofcontents | Abstract . . . . . . . . . . . iii
List of Figures . . . . . . . . . . . vii Chapter 1 Introduction . . . . . . . . . . . 1 1.1 Motivation . . . . . . . . . . . 1 1.2 Proposed Method . . . . . . . . . . . 2 1.3 Contribution . . . . . . . . . . . 5 1.4 Organization . . . . . . . . . . . 5 Chapter 2 RelatedWork 6 2.1 Augmented Reality. . . . . . . . . . . 6 2.1.1 Handheld AR . . . . . . . . . . . 7 2.1.2 Collaborative AR . . . . . . . . . . . 7 2.2 Image/Video-based UI . . . . . . . . . . . 8 2.3 Modelling from Video . . . . . . . . . . . 9 2.4 SLAM for AR . . . . . . . . . . . 10 2.5 Metaphors to Manipulate Virtual Models . . . . . . . . . . . 10 Chapter 3 Scenario . . . . . . . . . . . 12 3.1 Single User Scenario . . . . . . . . . . . 12 3.2 Collocated Sharing Scenario . . . . . . . . . . . 14 3.3 Remote Sharing Scenario . . . . . . . . . . . 14 Chapter 4 Design 16 4.1 Gesture Design . . . . . . . . . . . 16 4.1.1 Grab . . . . . . . . . . . 16 4.1.2 Carry . . . . . . . . . . . 17 4.1.3 Release . . . . . . . . . . . 18 4.2 System Design . . . . . . . . . . . 18 4.2.1 3D Scene Capture . . . . . . . . . . . 20 4.2.2 Strong Hint for Tracking . . . . . . . . . . . 21 4.2.3 Simple User Interaction . . . . . . . . . . . 21 4.2.4 Tracking and Reconstruction Pipeline . . . . . . . . . . . 22 4.2.5 Arbitrary Model Representation . . . . . . . . . . . 22 4.2.6 Revised Contour . . . . . . . . . . . 23 4.2.7 Visual Assistance . . . . . . . . . . . 24 Chapter 5 Implementation . . . . . . . . . . . 26 5.1 System Architecture . . . . . . . . . . . 26 5.2 Tracking and Reconstruction Pipeline . . . . . . . . . . . 27 5.2.1 Pose Estimation and Scene Integration . . . . . . . . . . . 28 5.2.2 Segmentation . . . . . . . . . . . 30 5.2.3 Model Integration . . . . . . . . . . . 31 5.2.4 Revised Contour Tracking . . . . . . . . . . . 31 5.2.5 Mesh Generation. . . . . . . . . . . 32 5.3 Model Interaction. . . . . . . . . . . 33 Chapter 6 Result . . . . . . . . . . . 38 6.1 System Performance. . . . . . . . . . . 38 6.2 Failure Case. . . . . . . . . . . 39 6.3 System Evaluation . . . . . . . . . . . 40 6.3.1 Qualitative User Study . . . . . . . . . . . . 40 6.3.2 Demonstration. . . . . . . . . . . 41 6.3.3 Feedback . . . . . . . . . . . 42 6.4 Discussion and Future Work . . . . . . . . . . . 44 6.4.1 AR 2.0. . . . . . . . . . . 44 6.4.2 Grab-Carry-Release with AR Measurement . . . . . . . . 46 6.4.3 Grab-Carry-Release with 3D Sketch . . . . . . . . . . . 46 Chapter 7 Conclusion . . . . . . . . . . . 48 Bibliography . . . . . . . . . . . 50 | |
| dc.language.iso | en | |
| dc.subject | 人因 | zh_TW |
| dc.subject | 設計 | zh_TW |
| dc.subject | 手持擴增實境 | zh_TW |
| dc.subject | 協同式擴增實境 | zh_TW |
| dc.subject | 實時模型重建 | zh_TW |
| dc.subject | 互動 | zh_TW |
| dc.subject | Real-time Model Reconstruction | en |
| dc.subject | Human Factors | en |
| dc.subject | Interaction | en |
| dc.subject | Handheld Augmented Reality | en |
| dc.subject | Collaborative Augmented Reality | en |
| dc.subject | Design | en |
| dc.title | 以手勢控制實時生成現場物體三維模型之互動應用裝置 | zh_TW |
| dc.title | Grab-Carry-Release: Virtually Placing Physical Objects in a Real Scene through a Smartphone with a RGB-D Camera | en |
| dc.type | Thesis | |
| dc.date.schoolyear | 100-2 | |
| dc.description.degree | 碩士 | |
| dc.contributor.oralexamcommittee | 梁容輝,陳彥仰,余能豪 | |
| dc.subject.keyword | 設計,人因,互動,手持擴增實境,協同式擴增實境,實時模型重建, | zh_TW |
| dc.subject.keyword | Design,Human Factors,Interaction,Handheld Augmented Reality,Collaborative Augmented Reality,Real-time Model Reconstruction, | en |
| dc.relation.page | 56 | |
| dc.rights.note | 有償授權 | |
| dc.date.accepted | 2012-07-23 | |
| dc.contributor.author-college | 管理學院 | zh_TW |
| dc.contributor.author-dept | 資訊管理學研究所 | zh_TW |
| 顯示於系所單位： | 資訊管理學系 | |
文件中的檔案：
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-101-1.pdf 未授權公開取用 | 2.69 MB | Adobe PDF |
系統中的文件，除了特別指名其著作權條款之外，均受到著作權保護，並且保留所有的權利。