Skip to main content
 首页 » 编程设计

python之优化 WER(单词错误率)代码

2024年12月31日19cloudgamer

我正在尝试计算 WER 以评估 ASR 系统,但计算分数需要花费大量时间(因为我想对其执行一些 Bootstrap 以获得置信区间,以便对系统进行更稳健的评估).

这是我到目前为止想出的代码,有没有人看到更有效的方法(更快,如果您有提高内存效率的想法,也欢迎)。

def modify_text(text): 
    """ 
    Function to modify a clean text to add some errors in it. 
    """ 
    modified_text = [] 
    for word in true_text: 
        action = np.random.choice(['deletion','addition','subsitution','nothing'], 
                                   p = [0.1,0.1,0.1,0.7]) 
        if action in ['addition','substitution']: 
            modified_text.append(random.choice(voca)) 
        if action in ['addition','nothing']: 
            modified_text.append(word) 
    return modified_text 
 
def wer(s1,s2): 
 
    d = np.zeros([len(s1)+1,len(s2)+1]) 
    d[:,0] = np.arange(len(s1)+1) 
    d[0,:] = np.arange(len(s2)+1) 
 
    for j in range(1,len(s2)+1): 
        for i in range(1,len(s1)+1): 
            if s1[i-1] == s2[j-1]: 
                d[i,j] = d[i-1,j-1] 
            else: 
                d[i,j] = min(d[i-1,j]+1, d[i,j-1]+1, d[i-1,j-1]+1) 
 
    return d[-1,-1]/len(s1) 
 
text = """I am happy to join with you today in what will go down in history as 
the greatest demonstration for freedom in the history of our nation. 
Five score years ago, a great American, in whose symbolic shadow 
we stand today, signed the Emancipation Proclamation. This momentous 
decree came as a great beacon light of hope to millions of Negro slaves 
who had been seared in the flames of withering injustice. It came as a 
joyous daybreak to end the long night of their captivity. """ 
 
true_text = list(tokenize(text)) 
modified_text = modify_text(true_text) 
%timeit wer(true_text,modified_text) 

输出:

7.04 ms ± 49.4 µs per loop (mean ± std. dev. of 7 runs, 100 loops each) 

好吧,这看起来还不错,但我有数以万计的文本需要使用 Bootstrap 进行评估,而且文本要长得多。因此,我想找到一种更快的方法来执行 wer 功能。有什么想法吗?

请您参考如下方法:

大多数语音识别评估首先将语音分割成句子或话语。然后你通过对齐每个话语来计算 WER。这可以大大加快您的速度,因为 WER 计算是 O(n^2)。