Skip to main content
 首页 » 编程设计

python之Pandas 如何不适用于整列

2025年01月19日12mfrbuaa

self.df['Regular Price'] = self.df['Regular Price'].apply( 
            lambda x: int(round(x)) if isinstance( 
                x, (int, float)) else None 
        ) 

只要在数据框中遇到非数字值,上面的代码就将 None 分配给字段 Regular Price 的每个值。我只想将 None 分配给非数字值所在的单元格。

谢谢

请您参考如下方法:

首先是不可能返回NaN与 integers ,因为 NaN s 是 float通过设计。

如果 mixed,您的解决方案有效类型 - 数字 string小号:

df = pd.DataFrame({ 
    'Regular Price': ['a',1,2.3,'a',7], 
    'B': list(range(5)) 
}) 
print (df) 
   B Regular Price 
0  0             a 
1  1             1 
2  2           2.3 
3  3             a 
4  4             7 
 
df['Regular Price'] = df['Regular Price'].apply( 
            lambda x: int(round(x)) if isinstance( 
                x, (int, float)) else None 
        ) 
 
print (df) 
   B  Regular Price 
0  0            NaN 
1  1            1.0 
2  2            2.0 
3  3            NaN 
4  4            7.0 

但是如果所有数据都是字符串需要 to_numeric 与 errors='coerce'将非数字转换为 NaN小号:

df = pd.DataFrame({ 
    'Regular Price': ['a','1','2.3','a','7'], 
    'B': list(range(5)) 
}) 
print (df) 
   B Regular Price 
0  0             a 
1  1             1 
2  2           2.3 
3  3             a 
4  4             7 
 
df['Regular Price'] = pd.to_numeric(df['Regular Price'], errors='coerce').round() 
print (df) 
   B  Regular Price 
0  0            NaN 
1  1            1.0 
2  2            2.0 
3  3            NaN 
4  4            7.0 

编辑:

I also need to remove floating points and use int only

可以通过转换为 None对于 NaN s 并转换为 int :

df['Regular Price'] = pd.to_numeric(df['Regular Price'], 
                                    errors='coerce').round() 
 
df['Regular Price'] = np.where(df['Regular Price'].isnull(),  
                               None, 
                               df['Regular Price'].fillna(0).astype(int)) 
 
print (df) 
   B Regular Price 
0  0          None 
1  1             1 
2  2             2 
3  3          None 
4  4             7 
 
 
print (df['Regular Price'].apply(type)) 
0    <class 'NoneType'> 
1         <class 'int'> 
2         <class 'int'> 
3    <class 'NoneType'> 
4         <class 'int'> 
Name: Regular Price, dtype: object 

但它会降低性能,所以最好不要使用它。应该还有另一个问题- soe 功能失败,所以最好是float如果使用 NaN小号:

测试一些功能,如 diff在 50k rows DataFrame :

df = pd.DataFrame({ 
    'Regular Price': ['a','1','2.3','a','7'], 
    'B': list(range(5)) 
}) 
df = pd.concat([df]*10000).reset_index(drop=True) 
print (df) 
 
df['Regular Price'] = pd.to_numeric(df['Regular Price'], errors='coerce').round() 
 
df['Regular Price1'] = np.where(df['Regular Price'].isnull(),  
                               None, 
                               df['Regular Price'].fillna(0).astype(int)) 

In [252]: %timeit df['Regular Price2'] = df['Regular Price1'].diff() 

TypeError: unsupported operand type(s) for -: 'int' and 'NoneType'

In [274]: %timeit df['Regular Price3'] = df['Regular Price'].diff() 
1000 loops, best of 3: 301 µs per loop 

In [272]: %timeit df['Regular Price2'] = df['Regular Price1'] * 1000 
100 loops, best of 3: 4.48 ms per loop 
 
In [273]: %timeit df['Regular Price3'] = df['Regular Price'] * 1000 
1000 loops, best of 3: 469 µs per loop 

编辑:

df = pd.DataFrame({ 
    'Regular Price': ['a','1','2.3','a','7'], 
    'B': list(range(5)) 
}) 
print (df) 
   B Regular Price 
0  0             a 
1  1             1 
2  2           2.3 
3  3             a 
4  4             7 
 
df['Regular Price'] = pd.to_numeric(df['Regular Price'], errors='coerce').round() 
print (df) 
   B  Regular Price 
0  0            NaN 
1  1            1.0 
2  2            2.0 
3  3            NaN 
4  4            7.0 

首先是可能删除 NaN s 行按列 Regular Price然后转换为 int .

df1 = df.dropna(subset=['Regular Price']).copy() 
df1['Regular Price']  = df1['Regular Price'].astype(int) 
print (df1) 
   B  Regular Price 
1  1              1 
2  2              2 
4  4              7 

处理你需要的,但不要改变索引。

#e.g. some process  
df1['Regular Price']  = df1['Regular Price'] * 100 

最后 combine_first - 添加 NaN至 Regular Price专栏。

df2 = df1.combine_first(df) 
print (df2) 
     B  Regular Price 
0  0.0            NaN 
1  1.0          100.0 
2  2.0          200.0 
3  3.0            NaN 
4  4.0          700.0