Skip to main content
 首页 » 编程设计

python之XGBOOST 特征名称错误之Python

2024年12月31日8findumars

可能这个问题已经以不同的形式被问过很多次了。但是,我的问题是当我将 XGBClassifier() 与数据之类的产品一起使用时,出现功能名称不匹配错误。我希望有人可以告诉我我做错了什么。这是我的代码。顺便说一句,数据完全是编造的:

import pandas as pd 
from sklearn.preprocessing import LabelEncoder, OneHotEncoder 
from sklearn.model_selection import train_test_split, KFold, cross_val_score 
from sklearn.metrics import accuracy_score 
import xgboost as xgb 
 
data = {"Age":[44,27,30,38,40,35,70,48,50,37], 
        "BMI":["25-29","35-39","30-35","40-45","45-49","20-25","<19",">70","50-55","55-59"], 
        "BP":["<140/90",">140/90",">140/90",">140/90","<140/90","<140/90","<140/90",">140/90",">140/90","<140/90"], 
        "Risk":["No","Yes","Yes","Yes","No","No","No","Yes","Yes","No"]} 
 
df = pd.DataFrame(data) 
 
X = df.iloc[:, :-1] 
y = df.iloc[:, -1] 
 
labelencoder = LabelEncoder() 
 
def encoder_X(columns): 
    for i in columns: 
        X.iloc[:, i] = labelencoder.fit_transform(X.iloc[:, i]) 
 
encoder_X([1,2]) 
 
y = labelencoder.fit_transform(y) 
 
onehotencdoer = OneHotEncoder(categorical_features = [[1,2]]) 
X = onehotencdoer.fit_transform(X).toarray() 
 
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size = 0.2, random_state = 13) 
 
model = xgb.XGBClassifier() 
model.fit(X_train, y_train, verbose = True) 
 
y_pred = model.predict(X_test) 
predictions = [round(value) for value in y_pred] 
 
accuracy = accuracy_score(y_test, predictions) 
print("Accuracy: {0}%".format(accuracy*100)) 

到目前为止一切顺利,没有错误。准确度分数是 100%,但那是因为它是一个编造的数据集,所以我并不担心这一点。

当我尝试根据模型对新数据集进行分类时,出现“特征名称不匹配错误”:

proddata = {"Age":[65,50,37], 
        "BMI":["25-29","35-39","30-35"], 
        "BP":["<140/90",">140/90",">140/90"]} 
 
prod_df = pd.DataFrame(proddata) 
 
def encoder_prod(columns): 
    for i in columns: 
        prod_df.iloc[:, i] = labelencoder.fit_transform(prod_df.iloc[:, i]) 
 
encoder_prod([1,2]) 
 
onehotencdoer = OneHotEncoder(categorical_features = [[1,2]]) 
prod_df = onehotencdoer.fit_transform(prod_df).toarray() 
 
predictions = model.predict(prod_df) 

在此之后我得到以下错误

predictions = model.predict(prod_df) 
Traceback (most recent call last): 
 
  File "<ipython-input-24-456b5626e711>", line 1, in <module> 
    predictions = model.predict(prod_df) 
 
  File "c:\users\sozdemir\appdata\local\programs\python\python35\lib\site-packages\xgboost\sklearn.py", line 526, in predict 
    ntree_limit=ntree_limit) 
 
  File "c:\users\sozdemir\appdata\local\programs\python\python35\lib\site-packages\xgboost\core.py", line 1044, in predict 
    self._validate_features(data) 
 
  File "c:\users\sozdemir\appdata\local\programs\python\python35\lib\site-packages\xgboost\core.py", line 1288, in _validate_features 
    data.feature_names)) 
 
ValueError: feature_names mismatch: ['f0', 'f1', 'f2', 'f3', 'f4', 'f5', 'f6', 'f7', 'f8', 'f9', 'f10', 'f11', 'f12'] ['f0', 'f1', 'f2', 'f3', 'f4', 'f5'] 
expected f6, f11, f12, f9, f7, f8, f10 in input data 

我知道这是由于 OneHotEncoding 在适合并转换为数组时发生的结果。不过我可能错了。

如果这是 OneHotEncoding 的结果,我是否可以不使用 OneHotEncoding,因为 LabelEncoder() 已经对分类值进行了编码?

非常感谢您的帮助和反馈。

PS:XGBOOST的版本是0.7

xgboost.__version__ 
Out[37]: '0.7' 

请您参考如下方法:

看来编码器安装后需要保存。我使用了 sklearn 中的 joblib。来自 https://machinelearningmastery.com/ 的杰森给了我保存编码器的想法。以下是编辑后的版本:

import pandas as pd 
from sklearn.preprocessing import LabelEncoder, OneHotEncoder 
from sklearn.model_selection import train_test_split, KFold, cross_val_score 
from sklearn.metrics import accuracy_score 
from sklearn.externals import joblib 
import xgboost as xgb 
 
data = {"Age":[44,27,30,38,40,35,70,48,50,37], 
        "BMI":["25-29","35-39","30-35","40-45","45-49","20-25","<19",">70","50-55","55-59"], 
        "BP":["<140/90",">140/90",">140/90",">140/90","<140/90","<140/90","<140/90",">140/90",">140/90","<140/90"], 
        "Risk":["No","Yes","Yes","Yes","No","No","No","Yes","Yes","No"]} 
 
df = pd.DataFrame(data) 
 
X = df.iloc[:, :-1] 
y = df.iloc[:, -1] 
 
labelencoder = LabelEncoder() 
 
def encoder_X(columns): 
    for i in columns: 
        X.iloc[:, i] = labelencoder.fit_transform(X.iloc[:, i]) 
 
encoder_X([1,2]) 
 
y = labelencoder.fit_transform(y) 
 
onehotencdoer = OneHotEncoder(categorical_features = [[1,2]]) 
onehotencdoer.fit(X) 
enc = joblib.dump(onehotencdoer, "encoder.pkl") # save the fitted encoder 
X = onehotencdoer.transform(X).toarray() 
 
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size = 0.2, random_state = 13) 
 
model = xgb.XGBClassifier() 
model.fit(X_train, y_train, verbose = True) 
 
y_pred = model.predict(X_test) 
predictions = [round(value) for value in y_pred] 
 
accuracy = accuracy_score(y_test, predictions) 
print("Accuracy: {0}%".format(accuracy*100)) 

现在,我们可以使用合适的编码器来转换产品数据:

proddata = {"Age":[65,50,37], 
        "BMI":["25-29","35-39","30-35"], 
        "BP":["<140/90",">140/90",">140/90"]} 
 
prod_df = pd.DataFrame(proddata) 
 
def encoder_prod(columns): 
    for i in columns: 
        prod_df.iloc[:, i] = labelencoder.fit_transform(prod_df.iloc[:, i]) 
 
encoder_prod([1,2]) 
enc = joblib.load("encoder.pkl") 
prod_df = enc.transform(prod_df).toarray() 
 
predictions = model.predict(prod_df) 
results = [round(val) for val in predictions] 

它似乎适用于此示例,我将在更大的数据集上尝试使用此方法。 请让我知道您的想法。

谢谢