我有一个需要标签编码的数据集。我正在使用 sklearn 的标签编码器。
这是问题的可重现代码:
import pandas as pd
from sklearn.preprocessing import LabelEncoder
data11 = pd.DataFrame({'Transaction_Type': ['Mortgage', 'Credit reporting', 'Consumer Loan', 'Mortgage'],
'Complaint_reason': ['Incorrect Info', 'False Statement', 'Using a Debit Card', 'Payoff process'],
'Company_response': ['Response1', 'Response2', 'Response3', 'Response1'],
'Consumer_disputes': ['Yes', 'No', 'No', 'Yes'],
'Complaint_Status': ['Processing','Closed', 'Awaiting Response', 'Closed']
})
le = LabelEncoder()
data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type'])
data11['Complaint_reason'] = le.transform(data11['Complaint_reason'])
data11['Company_response'] = le.fit_transform(data11['Company_response'])
data11['Consumer_disputes'] = le.transform(data11['Consumer_disputes'])
data11['Complaint_Status'] = le.transform(data11['Complaint_Status'])
期望的输出应该是这样的:
({'Transaction_Type': ['1', '2', '3', '1'],
'Complaint_reason': ['1', '2', '3', '4'],
'Company_response': ['1', '2', '3', '1'],
'Consumer_disputes': ['1', '2', '2', '1'],
'Complaint_Status': ['1','2', '3', '2']
})
问题是当我尝试对列进行编码时: “Transaction_Type”和“Company_response”编码成功,但列“Complaint_reason”、“Consumer_disputes”和“Complaint_Status”抛出错误。
对于“投诉原因”:
File "C:/Users/Ashu/untitled0.py", line 26, in <module>
data11['Complaint_reason'] = le.transform(data11['Complaint_reason'])
ValueError: y contains new labels: ['APR or interest rate' 'Account opening, closing, or management'
'Account terms and changes' ...
"Was approved for a loan, but didn't receive the money"
'Written notification about debt' 'Wrong amount charged or received']
“Consumer_disputes”也类似:
File "<ipython-input-117-9625bd78b740>", line 1, in <module>
data11['Consumer_disputes'] = le.transform(data11['Consumer_disputes'].astype(str))
ValueError: y contains new labels: ['No' 'Yes']
“Complaint_Status”也类似:
File "<ipython-input-119-5cd289c72e45>", line 1, in <module>
data11['Complaint_Status'] = le.transform(data11['Complaint_Status'])
ValueError: y contains new labels: ['Closed' 'Closed with explanation' 'Closed with monetary relief'
'Closed with non-monetary relief' 'Untimely response']
这些都是分类变量,具有句子形式的固定输入。以下是数据切片图片:
Categorical Data Label Encoding
SO 上有几个关于此的问题,但没有一个得到成功回答。
请您参考如下方法:
您缺少 fit_transform(),这就是您收到错误的原因。
sklearn.preprocessing.LabelEncoder -> 使用 0 到 n_classes-1 之间的值编码标签(来自官方文档)
不过如果你想在 1 和 n_classes 之间编码你的类,你只需要加 1。
data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type'])
data11['Transaction_Type']
输出:
0 2
1 1
2 0
3 2
Name: Transaction_Type, dtype: int64
注意这里,LabelEncoder()是按字母顺序编码的,它会给Consumer Loan一个标签0,按字母顺序排在第一位。类似地,它为 Mortage 提供标签 2,后者按顺序排在最后。
现在,您有两种编码方式,要么像这样接受 LabelEncoder 的默认输出,
data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type'])
data11['Complaint_reason'] = le.fit_transform(data11['Complaint_reason'])
data11['Company_response'] = le.fit_transform(data11['Company_response'])
data11['Consumer_disputes'] = le.fit_transform(data11['Consumer_disputes'])
data11['Complaint_Status'] = le.fit_transform(data11['Complaint_Status'])
输出:
Transaction_Type Complaint_reason Company_response Consumer_disputes Complaint_Status
0 2 1 0 1 2
1 1 0 1 0 1
2 0 3 2 0 0
3 2 2 0 1 1
或
data11['Transaction_Type'] = le.fit_transform(data11['Transaction_Type'].sort_values()) + 1
data11['Complaint_reason'] = le.fit_transform(data11['Complaint_reason'].sort_values()) + 1
data11['Company_response'] = le.fit_transform(data11['Company_response']) + 1
data11['Consumer_disputes'] = le.fit_transform(data11['Consumer_disputes'].sort_values()) + 1
data11['Complaint_Status'] = le.fit_transform(data11['Complaint_Status'].sort_values()) + 1
输出:
Transaction_Type Complaint_reason Company_response Consumer_disputes Complaint_Status
0 1 1 1 1 1
1 2 2 2 1 2
2 3 3 3 2 2
3 3 4 1 2 3
