Skip to main content
 首页 » 编程设计

python之多项式NB : ValueError

2024年11月01日10zhwl

在 Kaggle 的训练/测试集上尝试多项式 NB 分类器时,我得到了一个奇怪的 ValueError。我的(实践)目标是根据乘客的姓名预测乘客是男性还是女性,并将其输入 CountVectorizer。

--------------------------------------------------------------------------- 
ValueError                                Traceback (most recent call last) 
<ipython-input-97-ad69ee9ed02b> in <module>() 
     12  
     13 # classifier prediction - for test set now! 
---> 14 predict_Test = nb.predict(name_test) 
     15 score = accuracy_score(sex_test, predictions, normalize=True) 
     16 print score 
 
C:\Users\Evan Chow\Anaconda\lib\site-packages\sklearn\naive_bayes.pyc in predict(self, X) 
     61             Predicted target values for X 
     62         """ 
---> 63         jll = self._joint_log_likelihood(X) 
     64         return self.classes_[np.argmax(jll, axis=1)] 
     65  
 
C:\Users\Evan Chow\Anaconda\lib\site-packages\sklearn\naive_bayes.pyc in _joint_log_likelihood(self, X) 
    455         """Calculate the posterior log probability of the samples X""" 
    456         X = atleast2d_or_csr(X) 
--> 457         return (safe_sparse_dot(X, self.feature_log_prob_.T) 
    458                 + self.class_log_prior_) 
    459  
 
C:\Users\Evan Chow\Anaconda\lib\site-packages\sklearn\utils\extmath.pyc in safe_sparse_dot(a, b, dense_output) 
     81         return ret 
     82     else: 
---> 83         return np.dot(a, b) 
     84  
     85  
 
ValueError: matrices are not aligned 

我的代码是:

rawDataTrain = pd.read_csv('train.csv') 
trainData = pd.concat([rawDataTrain.Name, rawDataTrain.Sex], axis=1) 
 
# get name, sex training data 
cv_train = CountVectorizer(min_df = 0) 
cv_train.fit(trainData.Name) 
name_train = cv_train.transform(trainData.Name).toarray() # name_train 
sex_train = np.asarray(trainData.Sex, dtype='S') # name_test 
 
# get name, sex testing data 
rawDataTest = pd.read_csv('test.csv') 
testData = pd.concat([rawDataTest.Name, rawDataTest.Sex], axis=1) 
cv_test = CountVectorizer(min_df = 0) 
cv_test.fit(testData.Name) 
name_test = cv_test.transform(testData.Name).toarray() # name test 
sex_test = np.asarray(testData.Sex, dtype='S') # sex test 
 
# classifier prediction - test quickly on training set. you should get 1.0 
predictionsTrain = nb.predict(name_train) 
scoreTrain = accuracy_score(sex_train, predictionsTrain, normalize=True) 
print scoreTrain # returns probability of 1.0 
 
# classifier prediction - this is what goes weird! 
predict_Test = nb.predict(name_test) 
score = accuracy_score(sex_test, predictions, normalize=True) 
print score 

此外,name_train、name_test、sex_train 和 sex_test 的维度是:

(891, 1509) (418, 825) (891,) (418,)

似乎 name_train 和 name_test 的第一个坐标需要相同,但如果这是真的,预测将只适用于样本数量与训练集相同的矩阵!关于如何摆脱这个 ValueError 有什么想法吗?

请您参考如下方法:

它们需要具有相同的第二维度(即相同的列数)。您提供的所有形状都不具有与其他任何形状相同的第二维(除了根本没有第二维的两个,在这种情况下使用它们进行训练或测试没有多大意义)。