請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/47684
標題: | 基於圖像之影像生成引擎硬體架構設計與實現 Hardware Architecture Design and Implementation of Image-Based Rendering Engine |
作者: | Chieh-Li Chen 陳潔立 |
指導教授: | 簡韶逸(Shao-Yi Chien) |
關鍵字: | 影像生成,硬體架構,即時互動系統, Image-based rendering,Hardware architecture,Real-time interactive system, |
出版年 : | 2010 |
學位: | 碩士 |
摘要: | 現今的多媒體播放器以提供使用者高畫質的視覺享受為主要的訴求。舉凡電
視與電腦螢幕,在畫面大小不斷提昇的過程中,播放的影片與圖片畫質也愈來愈 高;2008年的台灣平面顯示器展CMO奇美推出了56吋的高解析度面板,支援 Quad FHD 3840x2160的高解析度,運用於高階用途醫療及3D設計;而在手持式裝置上,手機或是隨身聽等等,也都以高解析度的畫面為主要的發展方向。最新 一代推出的iPhone 4更使用了視網膜螢幕(Retina Display),每英吋內有高達326個像素(dpi),遠遠超過人眼視覺所能辨識的極限。然而儘管高解析度的播放畫面發展已經到了一個極限,現今的播放方式仍然隱藏著些許的限制:播放系統只能播放他們所接收到的資料,電視只能播放從電視台收到的節目,手機只能播放事先 存起來的影片或網路上傳過來的畫面,這樣的播放方式限制了使用者的觀賞角度與觀賞方式,使用者不能隨意地移動視角或是選擇特寫,只能被動的接受看到的東西。因此我們認為現今的播放系統在高畫質的畫面之外應該要提供更客製化的觀賞內容,讓使用者在觀賞的過程中可以更改觀賞的角度、與多媒體內容做互動、以及提供更多元的視覺感受與娛樂性給使用者,讓使用者不只是單方面的接收畫面資訊。 為達成這個目標,我們設計了一個即時的互動式系統,可鑲嵌在現今的播放系統中,來達成使用者與多媒體內容互動的目標。所設計的互動式系統的核心為影像生成引擎(Image-Based Rendering Engine)。影像生成引擎利用硬體加速來彌補現今嵌入式系統在運算上速度不夠快的缺失,達成與使用者的即時互動,以提供 更客製化的視覺感受給使用者。我們所提出的影像生成引擎可同時支援多種影像生成演算法,如二維全景圖(2D panorama)、同心拼圖技術(concentric mosaics)、深度影像繪圖法(depth-image based rendering)、以及我們自己設計的網球即時實境互動系統(Tennis Real Play),讓使用者在看完一場網球後可以與喜愛的網球選手來一場對決,或是體驗一下在溫布頓球場打球的感覺。 為了克服支援多種演算法導致硬體面積太大的問題,影像生成引擎使用了可重組的架構(reconfigurable architecture)與硬體分享技術(hardware sharing technique)來減少硬體面積的使用。而在支援影像生成演算法中最嚴重的頻寬問題則設計了快取機制(cache mechanism)來解決;除此之外,還使用了摺疊技術(folding technique)與先進先出佇列 (FIFO)讓硬體的使用率達到最佳化。 所提出的影像生成引擎實現於TSMC18製程。操作在100 MHz下,每秒鐘可處理30 張畫面以上。可被整合進現今的播放系統中。模擬結果顯示加入了快取機制(cache mechanism),頻寬可有效的節省82.3%,而使用了先進先出佇列(FIFO)可以上運算時間節省27.4%。另外與中央處理器(CPU)和圖形處理器(GPU)的比較結果顯示,提出的影像生成引擎在運算上可以比中央處理器(CPU)快9倍,比圖形處理器(GPU)快2倍以上。 Currently, the trend on the development of multimedia display system focuses on providing excellent image quality to users. As the resolution of television grows from standard definition (720×480) to quad full high definition (3840×2160), the latest iPhone 4 also provides Retina display, which has 326 dpi, already exceeds the threshold from which human eyes can tell the difference. However, the viewing experience is restricted to high visual quality because of some limitation of current display system. Current display systems only play the data they stored without any modification. It restrains the viewing experience of users that they can only watch multimedia contents without any interaction with them or adding their opinions into multimedia contents. Thus, we think a customized display system should be developed. The customized display system should have the ability to respond to users’ requirements and interact with users. To achieve this goal, we design an real-time interactive system, called image-based rendering engine, which introduces hardware acceleration to achieve real-time requirement and can be integrated into current display system, to bring more entertainment and to provide more interaction and more customized view experience to users. The proposed image-based rendering engine can support several existent image-based rendering algorithms, such as 2D panorama, concentric mosaics and depth-image based rendering. The image-based rendering engine can also support a new interactive system, called Tennis Real Play, letting users to interact with the broadcast tennis video contents and play a game after they watch the Grand Slam tournaments. In order to overcome the typical hardware design challenge in accelerating rendering algorithms, such as high throughput requirement, high bandwidth requirement, programmability and low cost, we employ reconfigurable architecture and hardware sharing techniques. Besides that, we also introduce folding technique, cache mechanism and FIFO to optimize our hardware architecture. The proposed image-based rendering engine is implementedwith TSMC 0.18μm process technology. The area of the image-based rendering engine is around 89662 gate counts with 499712 gate counts of memory. With the employ of cache mechanism, the corresponding bandwidth has reduced 82.3%. With the introduce of folding technique, the area has reduced 33.8%. And with FIFO, the total processing cycle decreases 27.4%. The proposed rendering engine can respond to users’ instruction and has rendering speed 9 times faster than CPU and 2 times faster than GPU. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/47684 |
全文授權: | 有償授權 |
顯示於系所單位: | 電子工程學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-99-1.pdf 目前未授權公開取用 | 1.41 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。