請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/73424
標題: | 利用參數修剪與量化技術以精簡語音除噪之深度學習模型 Increasing Compactness Of Deep Learning Based Speech Enhancement Models With Parameter Pruning And Quantization Techniques. |
作者: | Jyun-Yi Wu 吳俊易 |
指導教授: | 簡韶逸(Shao-Yi Chien) |
關鍵字: | 精簡架構,參數減化,參數量化,低運算成本, Compactness,Parameter Pruning,Parameter Quantization,Low Computational Cost, |
出版年 : | 2019 |
學位: | 碩士 |
摘要: | 近年來,由於深度學習的興起,許多應用於語音除噪的相關研究,不斷地被提出來;然而,一個符合現實環境,合適的深度學習之語音除噪方法,需要取得在除躁表現與運算成本間的平衡。在此,我們提出參數之減化與量化的方法,減化能移除掉深度學習神經網絡中,不必要的頻道;量化則是利用參數間的分群,有效縮小整體架構的尺寸。由於上述兩種方法作用在不同的原理中,故可同時應用於合適的語音除噪神經網絡中,來得到更精簡的架構。當同時運用參數減化與量化時,從實驗數據,可以將現有網絡大小縮小為原架構的 10.03%,與原架構相比,對於PESQ跟STOI,僅有1.43%及3.24%的下降。因此,在有限運算資源的裝置中,參數之減化與量化能被有效的利用在語音除噪系統中。 Most recent studies on deep learning based speech enhancement (SE) focused on improving denoising performance. However, successful SE applications require striking a desirable balance between denoising performance and computational cost in real scenarios. In this study, we propose a novel parameter pruning (PP) technique, which removes redundant channels in a neural network. In addition, a parameter quantization (PQ) technique was applied to reduce the size of a neural network by representing weights with fewer cluster centroids. Because the techniques are derived based on different concepts, the PP and PQ can be integrated to provide even more compact SE models. The experimental results show that the PP and PQ techniques produce a compacted SE model with a size of only 10.03% compared to that of the original model, resulting in minor performance losses of 1.43% (from 0.70 to 0.69) for STOI and 3.24% (from 1.85 to 1.79) for PESQ. The promising results suggest that the PP and PQ techniques can be used in a SE system in devices with limited storage and computation resources. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/73424 |
DOI: | 10.6342/NTU201900728 |
全文授權: | 有償授權 |
顯示於系所單位: | 電子工程學研究所 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-108-1.pdf 目前未授權公開取用 | 6.06 MB | Adobe PDF |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。