Skip to main content
 首页 » 编程设计

python之如何删除无关紧要的分类交互项 Python StatsModel

2025年02月15日10arxive

在统计模型中,添加交互项很容易。然而,并不是所有的交互作用都是显着的。我的问题是如何删除那些无关紧要的?例如库特尼机场。

# -*- coding: utf-8 -*- 
import pandas as pd 
import statsmodels.formula.api as sm 
 
 
if __name__ == "__main__": 
 
    # Read data 
    census_subdivision_without_lower_mainland_and_van_island = pd.read_csv('../data/augmented/census_subdivision_without_lower_mainland_and_van_island.csv') 
 
    # Fit all data 
    fit = sm.ols(formula="instagram_posts ~ airports * C(CNMCRGNNM) + ports_and_ferry_terminals + railway_stations + accommodations + visitor_centers + festivals + attractions + C(CNMCRGNNM) + C(CNSSSBDVS3)", data=census_subdivision_without_lower_mainland_and_van_island).fit() 
    print(fit.summary()) 

请您参考如下方法:

您可能还想考虑一项一项地删除功能(从最不重要的一项开始)。这是因为一个特征可能变得重要取决于另一个特征的存在或不存在。下面的代码将为您执行此操作(我假设您已经定义了 X 和 y ):

import operator 
import statsmodels.api as sm 
import pandas as pd 
 
def remove_most_insignificant(df, results): 
    # use operator to find the key which belongs to the maximum value in the dictionary: 
    max_p_value = max(results.pvalues.iteritems(), key=operator.itemgetter(1))[0] 
    # this is the feature you want to drop: 
    df.drop(columns = max_p_value, inplace = True) 
    return df 
 
insignificant_feature = True 
while insignificant_feature: 
        model = sm.OLS(y, X) 
        results = model.fit() 
        significant = [p_value < 0.05 for p_value in results.pvalues] 
        if all(significant): 
            insignificant_feature = False 
        else: 
            if X.shape[1] == 1:  # if there's only one insignificant variable left 
                print('No significant features found') 
                results = None 
                insignificant_feature = False 
            else:             
                X = remove_most_insignificant(X, results) 
print(results.summary())