Skip to main content
 首页 » 编程设计

python之打印嵌套交叉验证中选择的参数

2024年11月24日6arxive

下面是一个使用 scikit-learn 从 k 最近邻获得交叉验证预测的示例,k 由交叉验证选择。代码似乎有效,但我如何打印在每个外部折叠中选择的 k?

import numpy as np, sklearn 
 
n = 100 
X = np.random.randn(n, 2) 
y = np.where(np.sum(X, axis = 1) + np.random.randn(n) > 0, "blue", "red") 
 
preds = sklearn.model_selection.cross_val_predict( 
    X = X, 
    y = y, 
    estimator = sklearn.model_selection.GridSearchCV( 
       estimator = sklearn.neighbors.KNeighborsClassifier(), 
       param_grid = {'n_neighbors': range(1, 7)}, 
       cv = sklearn.model_selection.KFold(10, random_state = 133), 
       scoring = 'accuracy'), 
    cv = sklearn.model_selection.KFold(10, random_state = 144)) 

请您参考如下方法:

您不能直接从该函数中获取它,因此您需要将 cross_val_predict 替换为 cross_validate 并将 return_estimator 标志设置为真。然后,您可以使用键 estimator 选择返回字典中使用的估计器。估计器的选定参数存储在属性 best_params_ 中。所以

import numpy as np 
import sklearn 
# sklearn 0.20.3 doesn't seem to import submodules in __init__ 
# So importing them directly is required. 
import sklearn.model_selection 
import sklearn.neighbors 
 
n = 100 
X = np.random.randn(n, 2) 
y = np.where(np.sum(X, axis = 1) + np.random.randn(n) > 0, "blue", "red") 
 
scores = sklearn.model_selection.cross_validate( 
    X = X, 
    y = y, 
    estimator = sklearn.model_selection.GridSearchCV( 
       estimator = sklearn.neighbors.KNeighborsClassifier(), 
       param_grid = {'n_neighbors': range(1, 7)}, 
       cv = sklearn.model_selection.KFold(10, random_state = 133), 
       scoring = 'accuracy'), 
    cv = sklearn.model_selection.KFold(10, random_state = 144), 
    return_estimator=True) 
 
# Selected hyper-parameters for the estimator from the first fold 
print(scores['estimator'][0].best_params_) 

不幸的是,您无法获得实际预测和从同一函数中选择的超参数。如果需要,您将必须手动进行嵌套交叉验证:

cv = sklearn.model_selection.KFold(10, random_state = 144) 
estimator = sklearn.model_selection.GridSearchCV( 
       estimator = sklearn.neighbors.KNeighborsClassifier(), 
       param_grid = {'n_neighbors': range(1, 7)}, 
       cv = sklearn.model_selection.KFold(10, random_state = 133), 
       scoring = 'accuracy') 
for train, test in cv.split(X,y): 
    X_train, y_train = X[train], y[train] 
    X_test, y_test = X[test], y[test] 
    m = estimator.fit(X_train, y_train) 
    print(m.best_params_) 
    y_pred = m.predict(X_test) 
    print(y_pred)