Skip to main content
 首页 » 编程设计

python之逐组遍历 pandas

2025年05月04日11JeffreyZhao

我有一个 pandas 数据框 school_df,如下所示:

    school_id  date_posted date_completed 
0    A          2014-01-01  2014-01-01 
1    A          2014-01-01  2014-01-08 
2    A          2014-04-29  2014-05-01 
3    B          2014-01-01  2014-01-01 
4    B          2014-01-20  2014-02-23 

每一行代表该学校的一个项目。我想添加两列:对于每个唯一的 school_id,计算该日期之前发布的项目数量和该日期之前完成的项目数量。

下面的代码有效,但我有大约 300,000 所独特的学校,因此需要很长时间才能运行。有没有更快的方法来获得我正在寻找的东西?感谢您的协助!

import pandas as pd 
groups = school_df.groupby("school_id") 
blank_df = pd.DataFrame() 
for g, df in groups: 
    df['school_previous_projects'] = df.date_posted.map(lambda x: len(df[df.date_posted < x])) 
    df['school_previous_completed'] = df.date_posted.map(lambda x: len(df[df.date_completed < x])) 
    blank_df = pd.concat([blank_df, df]) 

请您参考如下方法:

试一试。应该比你的 for 循环和两个 map 更快。从你的框架开始

    school_id  date_posted date_completed 
0    A          2014-01-01  2014-01-01 
1    A          2014-01-01  2014-01-08 
2    A          2014-04-29  2014-05-01 
3    B          2014-01-01  2014-01-01 
4    B          2014-01-20  2014-02-23 

然后是一个函数。 getProjectCounts() 使用 bool 索引和一个简单的 count()

def getProjectCounts(row, df): 
    filter = (df["school_id"] == row["school_id"])  & (df["date_posted"] < row["date_posted"]) 
    dp_count = df[filter]["date_posted"].count() 
    filter = (df["school_id"] == row["school_id"])  & (df["date_completed"] < row["date_completed"]) 
    dc_count = df[filter]["date_completed"].count() 
    return pd.Series([dp_count, dc_count]) 

然后一个 apply() 具有逐行的功能

school_df[["school_previous_projects","school_previous_completed"]] = school_df.apply(lambda x : getProjectCounts(x, school_df),axis=1) 
 
 
  school_id date_posted date_completed  school_previous_projects  \ 
0         A  2014-01-01     2014-01-01                         0    
1         A  2014-01-01     2014-01-08                         0    
2         A  2014-04-29     2014-05-01                         2    
3         B  2014-01-01     2014-01-01                         0    
4         B  2014-01-20     2014-02-23                         1    
 
   school_previous_completed   
0                          0   
1                          1   
2                          2   
3                          0   
4                          1