Please use this identifier to cite or link to this item:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/73424
Title: | 利用參數修剪與量化技術以精簡語音除噪之深度學習模型 Increasing Compactness Of Deep Learning Based Speech Enhancement Models With Parameter Pruning And Quantization Techniques. |
Authors: | Jyun-Yi Wu 吳俊易 |
Advisor: | 簡韶逸(Shao-Yi Chien) |
Keyword: | 精簡架構,參數減化,參數量化,低運算成本, Compactness,Parameter Pruning,Parameter Quantization,Low Computational Cost, |
Publication Year : | 2019 |
Degree: | 碩士 |
Abstract: | 近年來,由於深度學習的興起,許多應用於語音除噪的相關研究,不斷地被提出來;然而,一個符合現實環境,合適的深度學習之語音除噪方法,需要取得在除躁表現與運算成本間的平衡。在此,我們提出參數之減化與量化的方法,減化能移除掉深度學習神經網絡中,不必要的頻道;量化則是利用參數間的分群,有效縮小整體架構的尺寸。由於上述兩種方法作用在不同的原理中,故可同時應用於合適的語音除噪神經網絡中,來得到更精簡的架構。當同時運用參數減化與量化時,從實驗數據,可以將現有網絡大小縮小為原架構的 10.03%,與原架構相比,對於PESQ跟STOI,僅有1.43%及3.24%的下降。因此,在有限運算資源的裝置中,參數之減化與量化能被有效的利用在語音除噪系統中。 Most recent studies on deep learning based speech enhancement (SE) focused on improving denoising performance. However, successful SE applications require striking a desirable balance between denoising performance and computational cost in real scenarios. In this study, we propose a novel parameter pruning (PP) technique, which removes redundant channels in a neural network. In addition, a parameter quantization (PQ) technique was applied to reduce the size of a neural network by representing weights with fewer cluster centroids. Because the techniques are derived based on different concepts, the PP and PQ can be integrated to provide even more compact SE models. The experimental results show that the PP and PQ techniques produce a compacted SE model with a size of only 10.03% compared to that of the original model, resulting in minor performance losses of 1.43% (from 0.70 to 0.69) for STOI and 3.24% (from 1.85 to 1.79) for PESQ. The promising results suggest that the PP and PQ techniques can be used in a SE system in devices with limited storage and computation resources. |
URI: | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/73424 |
DOI: | 10.6342/NTU201900728 |
Fulltext Rights: | 有償授權 |
Appears in Collections: | 電子工程學研究所 |
Files in This Item:
File | Size | Format | |
---|---|---|---|
ntu-108-1.pdf Restricted Access | 6.06 MB | Adobe PDF |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.