Skip to main content
 首页 » 编程设计

python之使用 SciLearn Kit 读取 Pandas 数据框时遇到问题

2024年12月31日9think

我是 Python 新手,在使用 Pandas 创建的数据帧上使用 SciLearn Kit 时遇到了问题。下面是代码:

import numpy as np 
import pandas as pd 
import seaborn as sns 
import matplotlib as plt 
import json 
%matplotlib inline 
 
data = pd.read_json('C:/Users/Desktop/Machine Learning/yelp_academic_dataset_business.json', lines=True, orient='columns', encoding='utf-8') 
dataframe = pd.DataFrame(data) 
 
list(dataframe) 
subset_data = dataframe.loc[(dataframe.city == 'Toronto')] 
print(subset_data) 
documents = subset_data.to_dict('records') 
 
from sklearn.feature_extraction.text import TfidfVectorizer, CountVectorizer 
 
no_features = 1000 
 
# NMF is able to use tf-idf 
tfidf_vectorizer = TfidfVectorizer(max_df=0.95, min_df=2, max_features=no_features, stop_words='english') 
tfidf = tfidf_vectorizer.fit_transform(documents) 
tfidf_feature_names = tfidf_vectorizer.get_feature_names() 
 
# LDA can only use raw term counts for LDA because it is a probabilistic graphical model 
tf_vectorizer = CountVectorizer(max_df=0.95, min_df=2, max_features=no_features, stop_words='english') 
tf = tf_vectorizer.fit_transform(documents) 
tf_feature_names = tf_vectorizer.get_feature_names() 

下面是我得到的错误。

AttributeError: 'dict' object has no attribute 'lower' 

数据集可在此处获得:kaggle.com/yelp-dataset/yelp-dataset 数据集:yelp_academic_dataset_business.json

任何帮助将不胜感激。谢谢。

请您参考如下方法:

如@Jarad 所述,您必须将 list 或 series 提供给 tfidf_vectorizer。因此,解决您的问题是

tfidf = tfidf_vectorizer.fit_transform(subset_data[records])