請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/101757完整後設資料紀錄
| DC 欄位 | 值 | 語言 |
|---|---|---|
| dc.contributor.advisor | 楊家驤 | zh_TW |
| dc.contributor.advisor | Chia-Hsiang Yang | en |
| dc.contributor.author | 羅宇呈 | zh_TW |
| dc.contributor.author | Yu-Chen Lo | en |
| dc.date.accessioned | 2026-03-04T16:19:40Z | - |
| dc.date.available | 2026-03-05 | - |
| dc.date.copyright | 2026-03-04 | - |
| dc.date.issued | 2026 | - |
| dc.date.submitted | 2026-02-04 | - |
| dc.identifier.citation | [1] A. F. H. Goetz, G. Vane, J. E. Solomon and B. N. Rock, “Imaging spectrometry for Earth remote sensing,” Science, vol. 228, no. 4704, pp. 1147–1153, June 1985.
[2] M. J. Khan, H. S. Khan, A. Yousaf, K. Khurshid and A. Abbas, “Modern trends in hyperspectral image analysis: a review,” IEEE Access, vol. 6, pp. 14118-14129, Mar. 2018. [3] R. Booysen, R. Gloaguen, S. Lorenz, R. Zimmermann, L. Andreani and P. A. M. Nex, “The Potential of Multi-Sensor Remote Sensing Mineral Exploration: Examples from Southern Africa,” IEEE International Geoscience and Remote Sensing Symposium, pp. 6027-6030, Nov. 2019. [4] C. M. Gevaert, J. Suomalainen, J. Tang and L. Kooistra, “Generation of spectral–temporal response surfaces by combining multispectral satellite and hyperspectral UAV imagery for precision agriculture applications,” IEEE Journal of Selected Topics in Applied Earth Observation Remote Sensing, vol. 8, no. 6, pp. 3140-3146, June 2015. [5] Y.-F. Zhong, X.-Y. Wang, Y. Xu, S.-Y. Wang, T.-Y. Jia, X. Hu, J. Zhao, L.-F. Wei and L.-P. Zhang, “Mini-UAV-borne hyperspectral remote sensing: from observation and processing to applications,” IEEE Geoscience Remote Sensing Magazine, vol. 6, no. 4, pp. 46-62, Dec. 2018. [6] X. Tao, M. E. Paoletti, L. Han, Z. Wu, P. Ren, J. Plaza, A. Plaza and J. M. Haut, “A New Deep Convolutional Network for Effective Hyperspectral Unmixing,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 6999-7012, Aug. 2022. [7] K. T. Shahid and I. D. Schizas, “Unsupervised Hyperspectral Unmixing via Nonlinear Autoencoders,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-13, May 2022. [8] M. Tang, Y. Qu and H. Qi, “Hyperspectral Nonlinear Unmixing via Generative Adversarial Network,” IEEE International Geoscience and Remote Sensing Symposium, pp. 2404-2407, Feb. 2020. [9] J. A. G. Jaramago, M. E. Paoletti, J. M. Haut, R. Fernandez-Beltran, A. Plaza and J. Plaza, “GPU parallel implementation of dual-depth sparse probabilistic latent Semantic analysis for hyperspectral Unmixing,” IEEE Journal of Selected Topics in Applied Earth Observation Remote Sensing, vol. 12, no. 9, pp. 3156-3167, Sept. 2019. [10] S. Bernabé, L. I. Jiménez, C. García, J. Plaza and A. Plaza, “Multicore real-time implementation of a full hyperspectral unmixing chain.” IEEE Geoscience and Remote Sensing Letter, vol. 15, no. 5, pp. 744-748, May 2018. [11] D. Fernandez, C. González, D. Mozos and S. Lopez, “FPGA implementation of the principal component analysis algorithm for dimensionality reduction of hyperspectral images,” Journal of Real-Time Image Processing, vol. 16, no. 5, pp. 1395-1406, Oct. 2019. [12] T. G. Cervero, J. Caba, S. López, J. D. Dondo, R. Sarmiento, F. Rincón, and J. López, “A Scalable and Dynamically Reconfigurable FPGA-Based Embedded System for Real-Time Hyperspectral Unmixing,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 8, no. 6, pp. 2894-2911, June 2015. [13] Q. Du and R. Nekovei, “Fast real-time onboard processing of hyperspectral imagery for detection and classification,” Journal of Real-Time Image Processing, vol. 4, no. 3, pp. 273–286, Aug. 2009. [14] J. Caba, M. Díaz, J. Barba, R. Guerra, S. Escolar and S. López, “Low-Power Hyperspectral Anomaly Detector Implementation in Cost-Optimized FPGA Devices,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 2379-2393, Mar. 2022. [15] S.-E. Qian, “Overview of Hyperspectral Imaging Remote Sensing from Satellites,” IEEE, 2023, pp. 41-66. [16] E. Ibarrola-Ulzurrun, L. Drumetz, J. Marcello, C. Gonzalo-Martín and J. Chanussot, “Hyperspectral classification through unmixing abundance maps addressing spectral variability,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 7, pp. 4775-4788, July 2019. [17] A. Khan, A. D. Vibhute, C. H. Patil and S. Mali, “Spectral Unmixing for End Member Extraction and Abundance Estimation,” IEEE International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE), pp. 653-658, Jan. 2023. [18] K. Tajiri and T. Maruyama, “FPGA Acceleration of a Supervised Learning Method for Hyperspectral Image Classification,” International Conference on Field-Programmable Technology, pp. 270-273, June 2018. [19] R. Macias, S. Bernabé, D. Báscones and C. González, “FPGA Implementation of a Hardware Optimized Automatic Target Detection and Classification Algorithm for Hyperspectral Image Analysis,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1-5, July 2022. [20] M. Guda, S. Gasser, M. S. El-Mahallawy and K. Shehata, “FPGA Implementation of L1/2 Sparsity Constrained Nonnegative Matrix Factorization Algorithm for Remotely Sensed Hyperspectral Image Analysis,” IEEE Access, vol. 8, pp. 12069-12083, Jan. 2020. [21] J. M. Bioucas-Dias, A. Plaza, N. Dobigeon, M. Parente, Q. Du, P. Gader and J. Chanussot, “Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches,” IEEE Journal of Selected Topics in Applied Earth Observation Remote Sensing, vol. 5, no. 2, pp. 354–379, Apr. 2012. [22] J. S. Bhatt and M. V. Joshi, “Deep Learning in Hyperspectral Unmixing: A Review,” IEEE International Geoscience and Remote Sensing Symposium, pp. 2189-2192, Feb. 2021. [23] L. Drumetz, M.-A. Veganzones, S. Henrot, R. Phlypo, J. Chanussot and C. Jutten, “Blind hyperspectral unmixing using an extended linear mixing model to address spectral variability,” IEEE Transactions on Image Processing, vol. 25, no. 8, pp. 3890-3905, Aug. 2016. [24] J.-M. Liu and J.-S. Zhang, “A New Maximum Simplex Volume Method Based on Householder Transformation for Endmember Extraction,” IEEE Transactions on Geoscience and Remote Sensing, vol. 50, no. 1, pp. 104-118, Jan. 2012. [25] R. Heylen, M. Parente and P. Gader, “A Review of Nonlinear Hyperspectral Unmixing Methods,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 7, no. 6, pp. 1844-1868, June 2014. [26] B. Du, S.-D. Wang, C. Xu, N. Wang, L.-P. Zhang and D.-C. Tao, “Multi-Task Learning for Blind Source Separation,” IEEE Transactions on Image Processing, vol. 27, no. 9, pp. 4219-4231, Sept. 2018. [27] Y.-T. Qian, S. Jia, J. Zhou and A. Robles-Kelly, “Hyperspectral Unmixing via L1/2 Sparsity-Constrained Nonnegative Matrix Factorization,” IEEE Transactions on Geoscience and Remote Sensing, vol. 49, no. 11, pp. 4282-4297, Nov. 2011. [28] J. M. Bioucas-Dias and J. M. P. Nascimento, “Hyperspectral Subspace Identification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 46, no. 8, pp. 2435-2445, Aug. 2008. [29] HYDICE Urban dataset, http://lesun.weebly.com/hyperspectral-data-set.html, (accessed Feb. 2022). [30] J. W. Boardman, F. A. Kruse and R. O. Green, “Mapping target signatures via partial unmixing of AVIRIS data,” Proc. Summaries JPL Airborne Earth Science Workshop, vol. 1, pp. 23–26, Dec. 1995. [31] M. E. Winter, “N-FINDR: An algorithm for fast autonomous spectral endmember determination in hyperspectral data,” Proc. SPIE Conf. Imaging Spectrometry, pp. 266–275, Oct. 1999. [32] J. M. P. Nascimento and J. M. B. Dias, “Vertex component analysis: A fast algorithm to unmix hyperspectral data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 43, no. 4, pp. 898–910, Apr. 2005. [33] C.-I. Chang, C.-C. Wu, W. Liu and Y.-C. Ouyang, “A new growing method for simplex-based endmember extraction algorithm,” IEEE Transactions on Geoscience and Remote Sensing, vol. 44, no. 10, pp. 2804–2819, Oct. 2006. [34] C. Gonzalez, J. Resano, A. Plaza and D. Mozos, “FPGA Implementation of Abundance Estimation for Spectral Unmixing of Hyperspectral Data Using the Image Space Reconstruction Algorithm,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 5, no. 1, pp. 248-261, Feb. 2012. [35] C.-C. Sun, J. Götze and G. E. Jan, “Parallel Jacobi EVD Methods on Integrated Circuits,” VLSI Design, 2014. [36] Y.-C. Lo, Y.-C. Wu and C.-H. Yang, “A 44.3 mW 62.4 fps Hyperspectral Image Processor for MAV Remote Sensing,” IEEE Symposium on VLSI Technology and Circuits, pp. 74-75, June 2022. [37] SNR in hyperspectral cameras, https://resonon.com/blog-snr-in-hyperspectral-cameras, (accessed June 2024). [38] V. V. S. Swarupa and M. Devanathan, “Hyperspectral Image Acquisition Methods and Processing Techniques Based on Traditional and Deep Learning Methodologies—A Study,” IEEE International Conference on Smart Technologies in Computing, Electrical and Electronics (ICSTCEE), pp. 1-13, Dec. 2022. [39] A. Plaza, J. Plaza, A. Paz and S. Sanchez, “Parallel Hyperspectral Image and Signal Processing,” IEEE Signal Processing Magazine, vol. 28, no. 3, pp. 119-126, May 2011. [40] C. González, S. Bernabé, A. Plaza and J. Plaza, “Edge Computing for Remote Sensing: Opportunities and Challenges,” IEEE Geoscience and Remote Sensing Magazine, vol. 10, no. 2, pp. 8-29, June 2022. [41] S. K. Roy, G. Krishna, S. R. Dubey and B. B. Chaudhuri, “HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification,” IEEE Geoscience and Remote Sensing Letters, vol. 17, no. 2, pp. 277-281, Feb. 2020. [42] Y. Chen, T. Luo, S. Liu, S. Zhang, L. He, J. Wang, L. Li, T. Chen, Z. Xu, N. Sun and O. Temam, “DaDianNao: A Machine-Learning Supercomputer,” IEEE/ACM International Symposium on Microarchitecture, pp. 609-622, Dec. 2014. [43] N. P. Jouppi et al., “In-Datacenter Performance Analysis of a Tensor Processing Unit,” ACM/IEEE Annual International Symposium on Computer Architecture, pp. 1-12, June 2017. [44] B. Somers, G. P. Asner, L. Tits and P. Coppin, “Endmember variability in spectral mixture analysis: A review,” Remote Sensing of Environment, vol. 115, no. 7, pp. 1603-1616, July 2011. [45] N. Yokoya, J. Chanussot and A. Iwasaki, “Nonlinear Unmixing of Hyperspectral Data Using Semi-Nonnegative Matrix Factorization,” IEEE Transactions on Geoscience and Remote Sensing, vol. 52, no. 2, pp. 1430-1437, Feb. 2014. [46] A. Villa, J. Chanussot, C. Jutten and S. Moreno, “On the use of ICA for hyperspectral image analysis,” IEEE International Geoscience and Remote Sensing Symposium, pp. 4922-4925, July 2009. [47] M. Horowitz, “1.1 Computing’s energy problem (and what we can do about it),” IEEE International Solid-State Circuits Conference Digest of Technical Papers, pp. 10-14, Feb. 2014. [48] V. Sze, Y.-H. Chen, T.-J. Yang and J. S. Emer, “Efficient Processing of Deep Neural Networks: A Tutorial and Survey,” Proceedings of the IEEE, vol. 105, no. 12, pp. 2295-2329, Dec. 2017.[1] A. F. H. Goetz, G. Vane, J. E. Solomon and B. N. Rock, “Imaging spectrometry for Earth remote sensing,” Science, vol. 228, no. 4704, pp. 1147–1153, June 1985. | - |
| dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/101757 | - |
| dc.description.abstract | 本文提出一款專用處理器,實現了高光譜影像(HSI)處理中完整的光譜解混流程,涵蓋降階(rank reduction)、端元(endmember)提取以及豐度(abundance)估計三個主要階段。為了在降低複雜度的同時保持高效能,本設計採用了多項創新的硬體優化技術。該架構中的處理單元(processing elements, PEs)採用摺疊(folding)與資料交錯(data interleaving)技術,以降低硬體複雜度並維持運算能力;同時配置深度流水線,以加速解混過程中的高運算量操作。在演算法層面,採用了基於豪斯霍爾德變換的單體成長(HTSG)演算法進行端元提取,並結合 L1 正則化的影像空間重建(ISR)方法進行豐度估計,在計算效率與解混精確度間取得平衡。此外,引入稀疏度自適應時脈控制機制(sparsity-adaptive clocking),利用資料稀疏性以降低動態功耗。
該處理器採用 40 奈米 CMOS 製程實現,核心面積為 2.56 mm²,在 0.68 V 供應電壓與 175 MHz 時脈下運行,功耗為 44.3 mW。此設計可同時生成 8 個端元及其對應的豐度圖,針對尺寸為 256×256×64 的 HSI 影像,運算吞吐率達到 62.4 張/秒。經實測,在 HYDICE Urban 數據集上可達到 33.2 dB 的峰值訊噪比(PSNR),驗證了本設計在實際應用場景中的有效性。 與高階 CPU 相比,本處理器在運算速度上提升 540 倍、能源效率約提升 1,700,000 倍、面積效率約提升 31,000 倍;與高階 GPU 相比,分別提升 17.5 倍、230,000 倍與 4,000 倍。透過創新的硬體架構設計與優化策略,本處理器能在功耗與尺寸限制下,達成即時高光譜解混運算,適用於電池供電的微型飛行載具(MAV)等遙測應用。 | zh_TW |
| dc.description.abstract | This paper presents a dedicated processor that implements the complete spectral unmixing workflow for hyperspectral image (HSI) processing, covering three key stages: rank reduction, endmember extraction, and abundance estimation. To achieve high performance while maintaining low complexity, the design incorporates several hardware optimization techniques. The architecture integrates folding and data interleaving techniques to reduce hardware complexity while maintaining computational capability. The processor employs deep-piped reconfigurable processing elements (PEs) to accelerate compute-intensive operations in the unmixing process. Through algorithm-architecture co-optimization, this processor achieves both high performance and hardware efficiency. It implements the Householder Transformation-based Simplex Growing (HTSG) algorithm with parallel CORDIC arrays for endmember extraction, while utilizing a simplified L1-regularized Image Space Reconstruction (ISR) scheme with folded processing elements for abundance estimation. A sparsity-adaptive clocking mechanism is introduced to exploit data sparsity and reduce dynamic power consumption.
The processor is fabricated in 40-nm CMOS technology, with a core area of 2.56 mm². It operates at 175 MHz from a 0.68-V supply and consumes 44.3 mW of power. The design supports the concurrent generation of 8 endmembers and their corresponding abundance maps for a 256×256×64 HSI, achieving a throughput of 62.4 frames per second. When tested on the HYDICE Urban dataset, the processor achieves a peak signal-to-noise ratio (PSNR) of 33.2 dB, validating its effectiveness in practical applications. Compared to a high-end CPU, the processor achieves a 540× increase in processing speed, 1,700,000× improvement in energy efficiency, and 31,000× improvement in area efficiency. Compared to a high-end GPU, it achieves 17.5× higher processing speed, 230,000× higher energy efficiency, and 4,000× higher area efficiency. Through innovative architectural design and optimization strategies, these results demonstrate that the processor can perform real-time hyperspectral unmixing within power and size constraints suitable for onboard deployment, such as in battery-powered micro air vehicles (MAVs) for remote sensing applications. | en |
| dc.description.provenance | Submitted by admin ntu (admin@lib.ntu.edu.tw) on 2026-03-04T16:19:40Z No. of bitstreams: 0 | en |
| dc.description.provenance | Made available in DSpace on 2026-03-04T16:19:40Z (GMT). No. of bitstreams: 0 | en |
| dc.description.tableofcontents | Acknowledgements - ii
摘要 - iii Abstract - v Contents - vii List of Figures - ix List of Tables - x 1 Introduction - 1 1.1 Hyperspectral Imaging - 1 1.1.1 Research Landscape and Paradigm Evolution - 3 1.2 Challenge of Hyperspectral Image Processing - 4 1.2.1 Critical Analysis of Existing Acceleration Approaches - 5 1.3 Contributions of This Work - 7 2 Background on Hyperspectral Unmixing - 8 2.1 Hyperspectral Unmixing - 8 2.2 Spectral Mixing Models - 9 2.2.1 Linear Mixture Model (LMM) - 9 2.2.2 Nonlinear Mixing Models (NLMM) - 10 2.3 Dataset and Evaluation Metrics - 11 2.3.1 Evaluation Metrics - 12 3 Spectral Unmixing Algorithms - 14 3.1 Rank Reduction - 15 3.2 Endmember Extraction - 18 3.3 Abundance Estimation - 23 4 Hardware Architecture - 28 4.1 Rank Reduction Unit - 29 4.2 Endmember extractor - 31 4.3 Abundance Estimator - 32 4.3.1 Processing Element Group - 32 4.3.2 Sparsity Adaptive Clock Gating - 34 4.4 Memory Bank - 36 4.5 Hardware Scheduling - 37 5 Experimental Verification - 38 5.1 Chip Implementation - 38 5.2 Performance Comparison - 44 6 Conclusion and Future Prospects - 46 References - 49 | - |
| dc.language.iso | en | - |
| dc.subject | 高光譜影像 | - |
| dc.subject | 光譜解混 | - |
| dc.subject | 端元提取 | - |
| dc.subject | 豐度估計 | - |
| dc.subject | 硬體加速器 | - |
| dc.subject | 特殊應用積體電路 | - |
| dc.subject | 低功耗設計 | - |
| dc.subject | 即時處理 | - |
| dc.subject | Hyperspectral imaging | - |
| dc.subject | Spectral unmixing | - |
| dc.subject | Endmember extraction | - |
| dc.subject | Abundance estimation | - |
| dc.subject | Hardware accelerator | - |
| dc.subject | ASIC | - |
| dc.subject | Low-power design | - |
| dc.subject | Real-time processing | - |
| dc.title | 應用於微型無人機遙測之高光譜影像處理器 | zh_TW |
| dc.title | A Hyperspectral Image Processor for Spectral Unmixing in MAV Remote Sensing | en |
| dc.type | Thesis | - |
| dc.date.schoolyear | 114-1 | - |
| dc.description.degree | 博士 | - |
| dc.contributor.oralexamcommittee | 張錫嘉;盧奕璋;蔡佩芸;翁詠祿 | zh_TW |
| dc.contributor.oralexamcommittee | Hsie-Chia Chang;Yi-Chang Lu;Pei-Yun Tsai;Yeong-Luh Ueng | en |
| dc.subject.keyword | 高光譜影像,光譜解混端元提取豐度估計硬體加速器特殊應用積體電路低功耗設計即時處理 | zh_TW |
| dc.subject.keyword | Hyperspectral imaging,Spectral unmixingEndmember extractionAbundance estimationHardware acceleratorASICLow-power designReal-time processing | en |
| dc.relation.page | 55 | - |
| dc.identifier.doi | 10.6342/NTU202600298 | - |
| dc.rights.note | 同意授權(全球公開) | - |
| dc.date.accepted | 2026-02-07 | - |
| dc.contributor.author-college | 電機資訊學院 | - |
| dc.contributor.author-dept | 電子工程學研究所 | - |
| dc.date.embargo-lift | 2026-03-05 | - |
| 顯示於系所單位: | 電子工程學研究所 | |
文件中的檔案:
| 檔案 | 大小 | 格式 | |
|---|---|---|---|
| ntu-114-1.pdf | 5.18 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。
