Skip to main content
 首页 » 编程设计

python之尝试在 python 中标记编码时,ValueError 包含新标签

2024年12月31日6fff_TT

我有一个需要标签编码的数据集。我正在使用 sklearn 的标签编码器。

这是问题的可重现代码:

import pandas as pd 
from sklearn.preprocessing import LabelEncoder 
 
data11 = pd.DataFrame({'Transaction_Type': ['Mortgage', 'Credit reporting', 'Consumer Loan', 'Mortgage'],  
                       'Complaint_reason': ['Incorrect Info', 'False Statement', 'Using a Debit Card', 'Payoff process'], 
                       'Company_response': ['Response1', 'Response2', 'Response3', 'Response1'], 
                       'Consumer_disputes': ['Yes', 'No', 'No', 'Yes'], 
                       'Complaint_Status': ['Processing','Closed', 'Awaiting Response', 'Closed'] 
                       }) 
 
le = LabelEncoder() 
data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type']) 
data11['Complaint_reason'] = le.transform(data11['Complaint_reason']) 
data11['Company_response'] = le.fit_transform(data11['Company_response']) 
data11['Consumer_disputes'] = le.transform(data11['Consumer_disputes']) 
data11['Complaint_Status'] = le.transform(data11['Complaint_Status']) 

期望的输出应该是这样的:

({'Transaction_Type': ['1', '2', '3', '1'],  
                       'Complaint_reason': ['1', '2', '3', '4'], 
                       'Company_response': ['1', '2', '3', '1'], 
                       'Consumer_disputes': ['1', '2', '2', '1'], 
                       'Complaint_Status': ['1','2', '3', '2'] 
                       }) 

问题是当我尝试对列进行编码时: “Transaction_Type”和“Company_response”编码成功,但列“Complaint_reason”、“Consumer_disputes”和“Complaint_Status”抛出错误。

对于“投诉原因”:

File "C:/Users/Ashu/untitled0.py", line 26, in <module> 
    data11['Complaint_reason'] = le.transform(data11['Complaint_reason']) 
 
ValueError: y contains new labels: ['APR or interest rate' 'Account opening, closing, or management' 
 'Account terms and changes' ... 
 "Was approved for a loan, but didn't receive the money" 
 'Written notification about debt' 'Wrong amount charged or received'] 

“Consumer_disputes”也类似:

  File "<ipython-input-117-9625bd78b740>", line 1, in <module> 
    data11['Consumer_disputes'] = le.transform(data11['Consumer_disputes'].astype(str)) 
 
ValueError: y contains new labels: ['No' 'Yes'] 

“Complaint_Status”也类似:

  File "<ipython-input-119-5cd289c72e45>", line 1, in <module> 
    data11['Complaint_Status'] = le.transform(data11['Complaint_Status']) 
 
ValueError: y contains new labels: ['Closed' 'Closed with explanation' 'Closed with monetary relief' 
 'Closed with non-monetary relief' 'Untimely response'] 

这些都是分类变量,具有句子形式的固定输入。以下是数据切片图片:

Categorical Data Label Encoding

SO 上有几个关于此的问题,但没有一个得到成功回答。

请您参考如下方法:

您缺少 fit_transform(),这就是您收到错误的原因。

sklearn.preprocessing.LabelEncoder -> 使用 0 到 n_classes-1 之间的值编码标签(来自官方文档)

不过如果你想在 1 和 n_classes 之间编码你的类,你只需要加 1。

data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type']) 
data11['Transaction_Type'] 

输出:

0    2 
1    1 
2    0 
3    2 
Name: Transaction_Type, dtype: int64  

注意这里,LabelEncoder()是按字母顺序编码的,它会给Consumer Loan一个标签0,按字母顺序排在第一位。类似地,它为 Mortage 提供标签 2,后者按顺序排在最后。

现在,您有两种编码方式,要么像这样接受 LabelEncoder 的默认输出,

data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type']) 
data11['Complaint_reason'] = le.fit_transform(data11['Complaint_reason']) 
data11['Company_response'] = le.fit_transform(data11['Company_response']) 
data11['Consumer_disputes'] = le.fit_transform(data11['Consumer_disputes']) 
data11['Complaint_Status'] = le.fit_transform(data11['Complaint_Status']) 

输出:

        Transaction_Type  Complaint_reason Company_response Consumer_disputes Complaint_Status 
0                   2            1              0              1                2 
1                   1            0              1              0                1 
2                   0            3              2              0                0 
3                   2            2              0              1                1 

或

data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type'].sort_values()) + 1 
data11['Complaint_reason'] = le.fit_transform(data11['Complaint_reason'].sort_values()) + 1 
data11['Company_response'] = le.fit_transform(data11['Company_response']) + 1 
data11['Consumer_disputes'] = le.fit_transform(data11['Consumer_disputes'].sort_values()) + 1 
data11['Complaint_Status'] = le.fit_transform(data11['Complaint_Status'].sort_values()) + 1  

输出:

    Transaction_Type    Complaint_reason    Company_response    Consumer_disputes   Complaint_Status 
0   1                      1                  1                      1              1 
1   2                      2                  2                      1              2 
2   3                      3                  3                      2              2 
3   3                      4                  1                      2              3