Skip navigation

DSpace

機構典藏 DSpace 系統致力於保存各式數位資料(如:文字、圖片、PDF)並使其易於取用。

點此認識 DSpace
DSpace logo
English
中文
  • 瀏覽論文
    • 校院系所
    • 出版年
    • 作者
    • 標題
    • 關鍵字
    • 指導教授
  • 搜尋 TDR
  • 授權 Q&A
    • 我的頁面
    • 接受 E-mail 通知
    • 編輯個人資料
  1. NTU Theses and Dissertations Repository
  2. 電機資訊學院
  3. 生醫電子與資訊學研究所
請用此 Handle URI 來引用此文件: http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/85650
完整後設資料紀錄
DC 欄位值語言
dc.contributor.advisor傅楸善zh_TW
dc.contributor.advisorChiou-Shann Fuhen
dc.contributor.author邵育翔zh_TW
dc.contributor.authorYu-Hsiang Shaoen
dc.date.accessioned2023-03-19T23:20:34Z-
dc.date.available2023-12-26-
dc.date.copyright2022-08-02-
dc.date.issued2022-
dc.date.submitted2002-01-01-
dc.identifier.citation[1] L. Li, “Time-of-Flight Camera – An Introduction,” Texas Instrument Technical White Paper, 2014.
[2] S. Q. Dai, C. J. Estrada, A. N. Xiong, et al., "CMOS-Compatible Time-of-Flight 3D Imaging Sensors and Systems," Proceedings of IEEE International Conference on ASIC, Kunming, China, pp. 1-4, 2021.
[3] M. Hansard, S. Lee, O. Choi, et al., “Time of Flight Cameras: Principles, Methods, and Applications,” SpringerBriefs in Computer Science, ISBN 978-1-4471-4658-2, pp. 95, 2012.
[4] J. Grunwald, “Investigation of Systematic Errors in Time-of-Flight Imaging,” Master Thesis, Graz University of Technology, 2013.
[5] D. Lefloch1, R. Nair et al., “Technical Foundation and Calibration Methods for Time-of-Flight Cameras,” Time-of-Flight and Depth Imaging Sensors Algorithms and Applications, vol. 8200, 2013.
[6] H. Rapp, “Experimental and Theoretical Investigation of Correlating TOF-Camera Systems,” Diploma Thesis, Heidelberg University, 2007.
[7] S. Fuchs, "Multipath Interference Compensation in Time-of-Flight Camera Images," Proceedings of International Conference on Pattern Recognition, Istanbul, Turkey, pp. 3583-3586, 2010.
[8] S. Foix, G. Alenya et al., "Lock-in Time-of-Flight (ToF) Cameras: A Survey," IEEE Sensors Journal, vol. 11, pp. 1917-1926, 2011.
[9] M. Levoy, “The Digital Michelangelo Project,” Stanford University, 1997 – 2003. https://accademia.stanford.edu/mich/, 2022.
[10] R. Szeliski, Computer Vision: Algorithms and Applications, Springer, London, 2021.
[11] C. Walker, “Stereo Vision Basics,”http://chriswalkertechblog.blogspot.com/2014/03/stereo-vision-basics.html, 2022.
[12] N. Lazaros, G. C. Sirakoulis et al., “Review of Stereo Vision Algorithms: From Software to Hardware,” International Journal of Optomechatronics, vol. 2, pp. 435-462, 2008.
[13] M. Tolgyessy, M. Dekan, et al., “Evaluation of the Azure Kinect and Its Comparison to Kinect V1 and Kinect V2,” Sensors, vol. 21, No. 413, pp. 1-25, 2021.
[14] T. Guzsvinecz, V. Szucs, C. Sik-Lanyi, “Suitability of the Kinect Sensor and Leap Motion Controller—A Literature Review,” Sensors, vol. 19, No. 1072, pp. 1-25, 2019.
[15] O. Wasenmuller, D. Stricker, “Comparison of Kinect V1 and V2 Depth Images in Terms of Accuracy and Precision,” Proceedings of Asian Conference on Computer Vision, vol. 10117, pp. 1-12, 2016.
[16] F. Remondino and D. Stoppa, Eds., TOF Range-Imaging Cameras, Vol. 68121, Springer, Heidelberg, Germany, 2013.
[17] P. Padmanabhan, C. Zhang, and E. Charbon, “Modeling and Analysis of a Direct Time-of-Flight Sensor Architecture for LiDAR Applications,” Sensors, vol. 19, No. 5464, pp. 1-27, 2019.
[18] S. Bellisai, F. Villa, "Indirect Time-of-Flight 3D Ranging Based on SPADs," Proc. SPIE, vol. 8268, pp. 1 –8, 2012.
[19] M. S. Keel et al., "A VGA Indirect Time-of-Flight CMOS Image Sensor with 4-Tap 7- μ m Global-Shutter Pixel and Fixed-Pattern Phase Noise Self-Compensation," IEEE Journal of Solid-State Circuits, vol. 55, pp. 889-897, 2020.
[20] M. Lindner, I. Schiller et al., “Time-of-Flight Sensor Calibration for Accurate Range Sensing,” Computer Vision and Image Understanding, vol. 114, pp. 1318-1328, 2010.
[21] S. Q. Dai, C. J. Estrada, et al., "CMOS-Compatible Time-of-Flight 3D Imaging Sensors and Systems," Proceedings of IEEE International Conference on ASIC, Chongqing, China, pp. 1-4, 2021.
[22] MathWorks, “What Is Camera Calibration?”https://www.mathworks.com/help/vision/ug/camera-calibration.html, 2022.
[23] S. Foix, G. Alenya, C. Torras, “Lock-in Time-of-Flight (ToF) Cameras: A survey,” IEEE Sensors Journal, vol. 11, pp. 1917 – 1926, 2011.
[24] T. Kahlmann, F. Remondino, and H. Ingensand, “Calibration for Increased Accuracy of the Range Imaging Camera SwissRanger,” ISPRS Commission V Symposium 'Image Engineering and Vision Metrology, Dresden, Germany, vol. XXXVI, pp. 136-141, 2005.
[25] Focus Technology, “CE Certificated 3-Zone Thermal Shock Test Chamber Environmental Test Machine,”https://gdkomeg.en.made-in-china.com/product/pSgQrmocRYVn/China-CE-Certificated-3-Zone-Thermal-Shock-Test-Chamber-Environmental-Test-Machine.html, 2022.
[26] IndiaMart InterMesh, “Hermoelectric Peltier Cooler or Cooling Module TEC 12706,” https://www.indiamart.com/proddetail/thermoelectric-peltier-cooler-or-cooling-module-tec-12706-20966491562.html, 2022.
[27] A. Duda, U. Frese, “Accurate Detection and Localization of Checkerboard Corners for Calibration,” Proceedings of British Machine Vision Conference, Newcastle, UK, pp. 1-10, 2018.
[28] OpenCV, “Camera Calibration and 3D Reconstruction,”https://docs.opencv.org/4.x/d9/d0c/group__calib3d.html#gadc5bcb05cb21cf1e50963df26986d7c9, 2022.
[29] Z. Z. You, “Flexible Camera Calibration by Viewing a Plane from Unknown Orientations,” Proceedings of IEEE International Conference on Computer Vision, Kerkyra, Corfu, Greece, vol. 1, pp. 666-673, 1999.
[30] OpenCV, “Geometric Image Transformations,”https://docs.opencv.org/4.x/da/d54/group__imgproc__transform.html#ga20f62aa3235d869c9956436c870893ae, 2022.
-
dc.identifier.urihttp://tdr.lib.ntu.edu.tw/jspui/handle/123456789/85650-
dc.description.abstractiTOF (indirect Time-of-Flight)間接飛時相機是藉由偵測到光波訊號碰到物體來回的相位差進行深度預測。如:Kinect 2.0、Samsung Galaxy手機深度鏡頭都是使用相關技術。然而,iToF 相機在偵測深度的過程中非常容易被外界影響,如:光線、溫度、接收器上每一個像素所接收到的時間差等都是需要在iToF相機出廠前進行校正以確保深度精準度。此篇研究主要探討iToF系统性的錯誤:擺動(Wiggling)、固定相位模式雜訊 (Fixed Phase Pattern Noise)、溫度漂(Temperature Drift)、鏡頭校正(Lens Distortion),四個項目進行深度鏡頭校正任務。
此篇論文會首先透過相位差計算偵測點深度,再透過傅立葉轉換找出最高與次高頻區間段,利用傅立葉反轉換回推每一像素針對擺動誤差的修正。固定相位模式雜訊為了將整體誤差降到最低,會透過不同深度計算偵測與實際深度誤差進行評估與多項式函式擬合方法找出最接近數值。此篇論文創造將四種不同深度放於一張相片進行校正,可以在最短時間內找出固定相位模式誤差的參數統計。溫度飄移在本篇論文會透過熱箱在不同溫度下的統計進行查表校正。最後在鏡頭校正部分則使用針孔相機模型與張正友校正法進行鏡頭評估。找出相機內部與外部參數,同時也計算出輻射失真、鏡頭與相機感測器之間的切向失真參數。
zh_TW
dc.description.abstractiToF, indirect Time-of-Flight, camera predicts depth by detecting the phase difference between the light-wave signal and the object, such as Kinect 2.0, and Samsung Galaxy mobile phone. However, iToF camera will easily be affected by the external environment when detecting depth, for example, sunlight temperature, time difference received by each pixel on the receiver, and so on. All need to be calibrated before leaving the factory to ensure depth accuracy. This study will mainly discuss the systematic errors of iToF: Wiggling, Fixed Phase Pattern Noise, Temperature Drift, Lens Distortion: the four main errors that affect results.
This thesis will first discuss how to calculate the depth information through different phases detected by iToF sensor, and then use Fourier transform to find the highest and second-highest frequency intervals, then use inverse Fourier transform to push back the correction of the wiggling error for each pixel. Besides, to minimize the fixed phase pattern noise, the actual depth errors are evaluated through the polynomial function fitting method. To get better results, we also focus on temperature drift by look-up table through the statistics of the thermal chamber at different temperatures. Finally, we use pinhole camera model to calibrate lens distortion.
en
dc.description.provenanceMade available in DSpace on 2023-03-19T23:20:34Z (GMT). No. of bitstreams: 1
U0001-0906202218241500.pdf: 7607988 bytes, checksum: 1cc2ec9e93935ec8817025f7c5249151 (MD5)
Previous issue date: 2022
en
dc.description.tableofcontentsCONTENTS

口試委員會審定書 i
誌謝 ii
中文摘要 iii
ABSTRACT iv
CONTENTS v
LIST OF FIGURES viii
LIST OF TABLES xii
Chapter 1 Introduction 1
1.1 Introduction for 3D camera 1
1.2 Introduction for ToF Camera 3
1.3 The Advantage of ToF Camera 5
1.4 The Disadvantage of ToF Camera 6
1.4.1 General Shortcoming 6
1.4.2 Extrinsic Influence 7
1.4.3 Systematic Error 9
1.5 Thesis Organization 9
Chapter 2 Related Works 11
2.1 History of 3D camera 11
2.2 3D View Implemented by Kinect v2 15
2.3 Difference between iToF Camera and dToF Camera 19
2.4 iToF Camera Calibration 22
Chapter 3 Background 26
3.1 iToF Camera Depth Calculation 26
3.2 Four Different Systematic Errors for iToF Camera 27
3.2.1 Temperature Drift 27
3.2.2 Wiggling Error 28
3.2.3 Lens Distortion 29
3.2.4 FPPN Error 31
Chapter 4 Methodology 32
4.1 Overview 32
4.2 Data Collection 33
4.3 ShaoCalibrate 36
4.3.1 Temperature Drift Calibration 36
4.3.2 Wiggling Calibration 38
4.3.3 Lens Distortion Calibration 43
4.3.4 FPPN Calibration 46
Chapter 5 Experimental Results 49
5.1 Experimental Setting 49
5.2 Lens Distortion and Camera Calibration Result 50
5.3 FPPN Result 53
5.4 Depth Estimation after ShaoCalibrate 55
Chapter 6 Conclusion and Future Works 62
References 63
-
dc.language.isoen-
dc.subject邵校正zh_TW
dc.subject間接飛時相機校正zh_TW
dc.subject系統性誤差校正zh_TW
dc.subject快速固定相位模式雜訊校正zh_TW
dc.subject間接飛時相機校正zh_TW
dc.subject邵校正zh_TW
dc.subject系統性誤差校正zh_TW
dc.subject快速固定相位模式雜訊校正zh_TW
dc.subjectiToF Camera Calibrationen
dc.subjectShaoCalibrateen
dc.subjectiToF Camera Calibrationen
dc.subjectShaoCalibrateen
dc.subjectSystematic Error Correctionen
dc.subjectSystematic Error Correctionen
dc.title邵校正: 三維飛時相機深度校正zh_TW
dc.titleShaoCalibrate: 3D Time-of-Flight Camera Depth Calibrationen
dc.typeThesis-
dc.date.schoolyear110-2-
dc.description.degree碩士-
dc.contributor.oralexamcommittee賴志宏;巫宗昇;沈立健zh_TW
dc.contributor.oralexamcommitteeJr-Hung Lai;Tzung-Sheng Wu;Li-Jian Shenen
dc.subject.keyword間接飛時相機校正,邵校正,系統性誤差校正,快速固定相位模式雜訊校正,zh_TW
dc.subject.keywordiToF Camera Calibration,ShaoCalibrate,Systematic Error Correction,en
dc.relation.page67-
dc.identifier.doi10.6342/NTU202200899-
dc.rights.note同意授權(全球公開)-
dc.date.accepted2022-06-27-
dc.contributor.author-college電機資訊學院-
dc.contributor.author-dept生醫電子與資訊學研究所-
dc.date.embargo-lift2027-06-21-
顯示於系所單位:生醫電子與資訊學研究所

文件中的檔案:
檔案 大小格式 
ntu-110-2.pdf
  此日期後於網路公開 2027-06-21
7.43 MBAdobe PDF
顯示文件簡單紀錄


系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。

社群連結
聯絡資訊
10617臺北市大安區羅斯福路四段1號
No.1 Sec.4, Roosevelt Rd., Taipei, Taiwan, R.O.C. 106
Tel: (02)33662353
Email: ntuetds@ntu.edu.tw
意見箱
相關連結
館藏目錄
國內圖書館整合查詢 MetaCat
臺大學術典藏 NTU Scholars
臺大圖書館數位典藏館
本站聲明
© NTU Library All Rights Reserved