Skip to main content
 首页 » 编程设计

python之根据值或列表的变化切片 python 数据框

2025年01月19日12pengyingh

我有一个数据框,我想根据列值的变化将其分成多个数据框。数据框看起来像:

                                               Image         Yaw  Sign 
0   IMG_170705_121224_0148_GRE_vig_ortho_correct.tif  -41.299461  -1.0 
1   IMG_170705_121226_0149_GRE_vig_ortho_correct.tif  -39.885353  -1.0 
2   IMG_170705_121228_0150_GRE_vig_ortho_correct.tif  -38.424816  -1.0 
3   IMG_170705_121230_0151_GRE_vig_ortho_correct.tif  -44.121506  -1.0 
4   IMG_170705_121232_0152_GRE_vig_ortho_correct.tif  -43.348404  -1.0 
5   IMG_170705_121234_0153_GRE_vig_ortho_correct.tif  -33.564381  -1.0 
6   IMG_170705_121236_0154_GRE_vig_ortho_correct.tif  -22.381189  -1.0 
7   IMG_170705_121238_0155_GRE_vig_ortho_correct.tif  -24.130825  -1.0 
8   IMG_170705_121240_0156_GRE_vig_ortho_correct.tif  -36.879814  -1.0 
9   IMG_170705_121242_0157_GRE_vig_ortho_correct.tif  -32.717499  -1.0 
10  IMG_170705_121244_0158_GRE_vig_ortho_correct.tif  -55.632034  -1.0 
11  IMG_170705_121246_0159_GRE_vig_ortho_correct.tif  -41.810268  -1.0 
12  IMG_170705_121248_0160_GRE_vig_ortho_correct.tif   -38.68877  -1.0 
13  IMG_170705_121250_0161_GRE_vig_ortho_correct.tif  -38.238991  -1.0 
14  IMG_170705_121252_0162_GRE_vig_ortho_correct.tif  -33.106453  -1.0 
15  IMG_170705_121254_0163_GRE_vig_ortho_correct.tif  -25.821913  -1.0 
16  IMG_170705_121256_0164_GRE_vig_ortho_correct.tif   56.908508   1.0 
17  IMG_170705_121258_0165_GRE_vig_ortho_correct.tif    48.51984   1.0 
18  IMG_170705_121300_0166_GRE_vig_ortho_correct.tif  114.620369   1.0 
19  IMG_170705_121302_0167_GRE_vig_ortho_correct.tif  106.544044   1.0 
20  IMG_170705_121304_0168_GRE_vig_ortho_correct.tif  105.703751   1.0 
21  IMG_170705_121306_0169_GRE_vig_ortho_correct.tif  111.010986   1.0 
22  IMG_170705_121308_0170_GRE_vig_ortho_correct.tif  100.446739   1.0 
23  IMG_170705_121310_0171_GRE_vig_ortho_correct.tif   87.035179   1.0 
24  IMG_170705_121312_0172_GRE_vig_ortho_correct.tif   93.275948   1.0 
25  IMG_170705_121314_0173_GRE_vig_ortho_correct.tif   84.998108   1.0 
26  IMG_170705_121316_0174_GRE_vig_ortho_correct.tif   97.052902   1.0 
27  IMG_170705_121318_0175_GRE_vig_ortho_correct.tif   99.751534   1.0 
28  IMG_170705_121320_0176_GRE_vig_ortho_correct.tif   97.002548   1.0 
29  IMG_170705_121322_0177_GRE_vig_ortho_correct.tif    98.25058   1.0 
..                                               ...         ...   ... 
54  IMG_170705_121412_0202_GRE_vig_ortho_correct.tif  -71.117188  -1.0 
55  IMG_170705_121414_0203_GRE_vig_ortho_correct.tif  -55.625908  -1.0 
56  IMG_170705_121416_0204_GRE_vig_ortho_correct.tif  -49.295944  -1.0 
57  IMG_170705_121418_0205_GRE_vig_ortho_correct.tif  -36.872471  -1.0 
58  IMG_170705_121420_0206_GRE_vig_ortho_correct.tif   -34.20092  -1.0 
59  IMG_170705_121422_0207_GRE_vig_ortho_correct.tif  -34.930763  -1.0 
60  IMG_170705_121424_0208_GRE_vig_ortho_correct.tif  -37.000858  -1.0 
61  IMG_170705_121426_0209_GRE_vig_ortho_correct.tif  -39.504391  -1.0 
62  IMG_170705_121428_0210_GRE_vig_ortho_correct.tif  -41.150524  -1.0 
63  IMG_170705_121430_0211_GRE_vig_ortho_correct.tif  -39.845219  -1.0 
64  IMG_170705_121432_0212_GRE_vig_ortho_correct.tif   -39.10614  -1.0 
65  IMG_170705_121434_0213_GRE_vig_ortho_correct.tif  -35.891712  -1.0 
66  IMG_170705_121436_0214_GRE_vig_ortho_correct.tif   -37.41824  -1.0 
67  IMG_170705_121438_0215_GRE_vig_ortho_correct.tif  -34.713837  -1.0 
68  IMG_170705_121440_0216_GRE_vig_ortho_correct.tif  -48.803596  -1.0 
69  IMG_170705_121442_0217_GRE_vig_ortho_correct.tif  -44.784882  -1.0 
70  IMG_170705_121444_0218_GRE_vig_ortho_correct.tif  -40.010029  -1.0 
71  IMG_170705_121446_0219_GRE_vig_ortho_correct.tif  -42.793995  -1.0 
72  IMG_170705_121448_0220_GRE_vig_ortho_correct.tif  -41.527176  -1.0 
73  IMG_170705_121450_0221_GRE_vig_ortho_correct.tif  -39.461327  -1.0 
74  IMG_170705_121452_0222_GRE_vig_ortho_correct.tif  -39.929741  -1.0 
75  IMG_170705_121454_0223_GRE_vig_ortho_correct.tif  -40.532288  -1.0 
76  IMG_170705_121456_0224_GRE_vig_ortho_correct.tif   -45.85107  -1.0 
77  IMG_170705_121458_0225_GRE_vig_ortho_correct.tif  -41.356819  -1.0 
78  IMG_170705_121500_0226_GRE_vig_ortho_correct.tif  -45.120956  -1.0 
79  IMG_170705_121502_0227_GRE_vig_ortho_correct.tif  -49.955151  -1.0 
80  IMG_170705_121504_0228_GRE_vig_ortho_correct.tif  -54.691364  -1.0 
81  IMG_170705_121506_0229_GRE_vig_ortho_correct.tif  -47.738556  -1.0 
82  IMG_170705_121508_0230_GRE_vig_ortho_correct.tif  -37.778706  -1.0 
83  IMG_170705_121510_0231_GRE_vig_ortho_correct.tif  -39.388027  -1.0 

每次 Sign 从正面变为负面或反面变化时,切片都需要发生。问题是我有多个数据帧要切片,每个数据帧的结构都与 Sign 列不同,因此一些数据帧可能有 3 个切片(就像这个一样),而其他数据帧可能有更多.

我可以很容易地得到切片的索引值:

for mid, group in itertools.groupby(image_list['Sign'], key=operator.itemgetter(0)): 
    length.append(len(list(group))) 
 
index = [] # store the index values for splitting the dataframe 
total = 0 # reset total value 
 
for i in length: # loop through length values for each 'group' 
    total = total +i # add each value to get compound index values 
    index.append(total) # these are the index values to split the dataframe 

这给了我 [16, 53, 84] 其中 image_list 是数据框,但是这个列表然后需要在 for 循环中作为索引值应用某种。以下工作正常但不是自适应的(即仅适用于 image_list 的结构)。

df1 = image_list.iloc[0:index[0]] 
df2 = image_list.iloc[index[0]:index[1]] 
df3 = image_list.iloc[index[1]:index[2]] 

因此,如何根据 Sign 列值的变化以适用于多个数据帧的方式对数据帧进行切片?

顺便说一句:切片的结果可以是dict、list 或dataframe。

请您参考如下方法:

您可以获得一个列表,其中每个元素都是一个数据帧,循环使用您已有的 index 列表。

如果 len(index)==3,考虑到 index 的构建方式意味着将生成 3 个数据帧,因此您实际上需要 4 个分隔符。您可以在 index 的开头使用 None 获取它们(因为最后一行已经在 index 中)。因此,发布的代码应修改为以下内容:

index = [None] # store the index values for splitting the dataframe, a 0 would work too 
total = 0 # reset total value 
 
for i in length: # loop through length values for each 'group' 
    total = total +i # add each value to get compound index values 
    index.append(total) # these are the index values to split the dataframe 

这将返回一个包含 [None, 16, 53, 84] 的列表。使用此列表,您可以毫无问题地在边缘进行切片:

df_list = [image_list.iloc[index[i]:index[i+1]] for i in range(len(index)-1)] 

这利用了 a[None:i] 等同于 a[:i] 的优势(另外,a[i:]是 a[i:None])。