在统计模型中,添加交互项很容易。然而,并不是所有的交互作用都是显着的。我的问题是如何删除那些无关紧要的?例如库特尼机场。
# -*- coding: utf-8 -*-
import pandas as pd
import statsmodels.formula.api as sm
if __name__ == "__main__":
# Read data
census_subdivision_without_lower_mainland_and_van_island = pd.read_csv('../data/augmented/census_subdivision_without_lower_mainland_and_van_island.csv')
# Fit all data
fit = sm.ols(formula="instagram_posts ~ airports * C(CNMCRGNNM) + ports_and_ferry_terminals + railway_stations + accommodations + visitor_centers + festivals + attractions + C(CNMCRGNNM) + C(CNSSSBDVS3)", data=census_subdivision_without_lower_mainland_and_van_island).fit()
print(fit.summary())
请您参考如下方法:
您可能还想考虑一项一项地删除功能(从最不重要的一项开始)。这是因为一个特征可能变得重要取决于另一个特征的存在或不存在。下面的代码将为您执行此操作(我假设您已经定义了 X 和 y ):
import operator
import statsmodels.api as sm
import pandas as pd
def remove_most_insignificant(df, results):
# use operator to find the key which belongs to the maximum value in the dictionary:
max_p_value = max(results.pvalues.iteritems(), key=operator.itemgetter(1))[0]
# this is the feature you want to drop:
df.drop(columns = max_p_value, inplace = True)
return df
insignificant_feature = True
while insignificant_feature:
model = sm.OLS(y, X)
results = model.fit()
significant = [p_value < 0.05 for p_value in results.pvalues]
if all(significant):
insignificant_feature = False
else:
if X.shape[1] == 1: # if there's only one insignificant variable left
print('No significant features found')
results = None
insignificant_feature = False
else:
X = remove_most_insignificant(X, results)
print(results.summary())
