請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/19408
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 莊永裕 | |
dc.contributor.author | Lin-Chen Shen | en |
dc.contributor.author | 沈林承 | zh_TW |
dc.date.accessioned | 2021-06-08T01:57:37Z | - |
dc.date.copyright | 2016-07-04 | |
dc.date.issued | 2016 | |
dc.date.submitted | 2016-06-30 | |
dc.identifier.citation | [1] Ricoh theta. [Online; accessed 1-June-2016].
[2] V.360◦ hd camera kit. [Online; accessed 1-June-2016]. [3] I. Bronshtein, K. Semendyayev, and K. Kirsch. Handbook of mathematics. 1997. [4] R. Carroll, A. Agarwala, and M. Agrawala. Image warps for artistic perspective manipulation. In ACM Transactions on Graphics (TOG), volume 29, page 127. ACM, 2010. [5] B.-Y. Chen, K.-Y. Lee, W.-T. Huang, and J.-S. Lin. Capturing intention-based full-frame video stabilization. In Computer Graphics Forum, volume 27, pages 1805–1814. Wiley Online Library, 2008. [6] A. Goldstein and R. Fattal. Video stabilization using epipolar geometry. ACM Transactions on Graphics (TOG), 31(5):126, 2012. [7] M. Grundmann, V. Kwatra, and I. Essa. Auto-directed video stabilization with robust l1 optimal camera paths. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 225–232. IEEE, 2011. [8] T. Igarashi, T. Moscovich, and J. F. Hughes. As-rigid-as-possible shape manipulation. ACM transactions on Graphics (TOG), 24(3):1134–1141, 2005. [9] W. Kabsch. A solution for the best rotation to relate two sets of vectors. Acta Crystallographica Section A: Crystal Physics, Diffraction, Theoretical and General Crystallography, 32(5):922–923, 1976. [10] K.-Y. Lee, Y.-Y. Chuang, B.-Y. Chen, and M. Ouhyoung. Video stabilization using robust feature trajectories. In Proceedings of IEEE Conference on Computer Vision (ICCV 2009), pages 1397–1404, 2009. [11] F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Content-preserving warps for 3d video stabilization. In ACM Transactions on Graphics (TOG), volume 28, page 44. ACM, 2009. [12] S. Liu, L. Yuan, P. Tan, and J. Sun. Bundled camera paths for video stabilization. ACM Transactions on Graphics (TOG), 32(4):78, 2013. [13] S. Liu, L. Yuan, P. Tan, and J. Sun. Steadyflow: Spatially smooth optical flow for video stabilization. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 4209–4216. IEEE, 2014. [14] B. D. Lucas, T. Kanade, et al. An iterative image registration technique with an application to stereo vision. In IJCAI, volume 81, pages 674–679, 1981. [15] S. Schaefer, T. McPhail, and J. Warren. Image deformation using moving least squares. In ACM transactions on graphics (TOG), volume 25, pages 533–540. ACM, 2006. [16] R. G. von Gioi, J. Jakubowicz, J.-M. Morel, and G. Randall. Lsd: a line segment detector. Image Processing On Line, 2:35–55, 2012. [17] Y.-S. Wang, H. Fu, O. Sorkine, T.-Y. Lee, and H.-P. Seidel. Motion-aware temporal coherence for video resizing. ACM Transactions on Graphics (TOG), 28(5):127, 2009. [18] Y.-S. Wang, F. Liu, P.-S. Hsu, and T.-Y. Lee. Spatially and temporally optimized video stabilization. Visualization and Computer Graphics, IEEE Transactions on, 19(8):1354–1361, 2013. [19] Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image resizing. ACM Transactions on Graphics (TOG), 27(5):118, 2008. [20] Z. Zhou, H. Jin, and Y. Ma. Plane-based content preserving warps for video stabilization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2299–2306, 2013. | |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/19408 | - |
dc.description.abstract | 這篇論文提出了一種解決360度環景影片手震問題的方法。
這類型的影片又可細分成兩種:圓柱型與球型。 針對傳統影片而設計的影片去手震演算法,會因為極度寬闊的視角而無法適切的運作在這類型的影片上。 我們觀察到對360影片來說,相機的旋轉必須極度平滑,來保持全域的動態一致性和避免景物的搖晃效果。 另外在虛擬實境的應用中,為了能讓播放畫面跟隨著使用者的視角,原始相機的旋轉也是必須被移除的。 我們的方法將旋轉自其他的相機運動中抽取出來,並使用不同的策略來平滑化各個部分。 首先我們會估計每個影格之間的旋轉量。 在移除了旋轉後,會套用一個利用網格操作的變形方法來處理剩餘那些因平移或視差造成的抖動。 不僅如此,我們還提出了一個新型的網格變形演算法,利用正二十面體與其延伸之多面體來處理球型影片。 適當的旋轉會在之後被決定並加回影片中,用以保持讓畫面非常平順,或另外根據使用者需求來調整。 另外,我們提供了一個傾斜校正的演算法,可用以移除令人不適的相機傾斜問題。 實驗顯現我們的方法可以有效的運用在製作穩定的360環景影片上。 | zh_TW |
dc.description.abstract | This thesis presents a method for stabilizing panorama videos with 360◦ field of view. There are two types of panorama videos: cylindrical one and spherical one. Video stabilization methods for conventional videos do not work properly on these because of the extremely wide angle of view. We observe that rotation needs to be extremely smooth for 360◦ videos to maintain global motion coherency and avoid wobbling. It is also necessary to remove the camera rotation for the virtual reality application since the displaying view should follow the user’s viewpoint when playing the video. Our method decouples the rotation from other motions and applies different strategies for smoothing them. The method first estimates the rotations between frames. After removing rotations, a mesh-based image warping method is used to handle remaining jitters caused by camera translation and parallax. Furthermore, we propose a new type of mesh warping method using 3D icosphere mesh in the spherical case. The desired rotation can then be determined and restored by either heavily smoothing the original rotations or being assigned by the user interaction. Optionally, a tilt correction method can be applied to remove unwanted camera tilt. Experiments show that our method is effective in making steady 360◦ videos. | en |
dc.description.provenance | Made available in DSpace on 2021-06-08T01:57:37Z (GMT). No. of bitstreams: 1 ntu-105-R03944024-1.pdf: 10652597 bytes, checksum: 2773163e3b3e49b56661476632e0e150 (MD5) Previous issue date: 2016 | en |
dc.description.tableofcontents | 誌謝 ii
摘要 iii Abstract iv 1 Introduction 1 2 Related work 6 2.1 Video stabilization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2.2 Mesh-based image warping . . . . . . . . . . . . . . . . . . . . . . . . . 7 3 Cylindrical video stabilization 8 3.1 Camera projection model . . . . . . . . . . . . . . . . . . . . . . . . . . 9 3.2 Orientation estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3.3 Trajectory smoothing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 3.4 Orientation assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 4 Tilt correction 16 4.1 Line segment detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 4.2 Tilt detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 4.3 Tilt correction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 5 Spherical video stabilization 19 5.1 Camera projection model . . . . . . . . . . . . . . . . . . . . . . . . . . 19 5.2 Trajectory smoothing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 6 Experiments and results 23 6.1 Cylindrical videos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 6.2 Spherical videos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 7 Conclusion 29 A Weighted average of points on a cylinder 30 A.1 The case for the 2D plane . . . . . . . . . . . . . . . . . . . . . . . . . . 31 A.2 The case for the unfolded 3D cylinder . . . . . . . . . . . . . . . . . . . 33 Bibliography 34 | |
dc.language.iso | en | |
dc.title | 360 環景影片去手震 | zh_TW |
dc.title | 360 Panorama Video Stabilization | en |
dc.type | Thesis | |
dc.date.schoolyear | 104-2 | |
dc.description.degree | 碩士 | |
dc.contributor.coadvisor | 陳祝嵩 | |
dc.contributor.oralexamcommittee | 陳煥宗,賴尚宏 | |
dc.subject.keyword | 影片去手震,基於網格的影像變形, | zh_TW |
dc.subject.keyword | video stabilization,mesh-based image warping, | en |
dc.relation.page | 36 | |
dc.identifier.doi | 10.6342/NTU201600602 | |
dc.rights.note | 未授權 | |
dc.date.accepted | 2016-06-30 | |
dc.contributor.author-college | 電機資訊學院 | zh_TW |
dc.contributor.author-dept | 資訊網路與多媒體研究所 | zh_TW |
顯示於系所單位: | 資訊網路與多媒體研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-105-1.pdf 目前未授權公開取用 | 10.4 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。