Skip to main content
 首页 » 编程设计

python之使用多处理并行化 scipy.optimize.leastsq

2025年02月15日7leader

基于 https://stackoverflow.com/a/10552563/8235309 ,我正在尝试并行执行 scipy.optimize.leastsq。 xx,yy,zz 是 3D 云点的坐标,我计算线点距离。

import multiprocessing 
import numpy as np 
from scipy.optimize import leastsq 
 
p = [55, 0, 55, 0] 
 
xx=np.array([ 54.696,  54.272,  54.272,  53.424,  53.424,  53.424,  53.848, 
53.424,  53.848,  53.424,  53.424,  53.424,  53.848,  53.848, 
53.848,  53.424,  53.424,  53.424,  53.424,  53.424,  53.848, 
53.848,  53.424,  53.424,  53.848,  53.848,  53.424,  53.848, 
53.424]) 
yy=np.array([ 53.848,  53.424,  53.848,  53.424,  53.848,  53.848,  53.848, 
53.848,  53.848,  52.576,  53.424,  53.848,  52.576,  53.424, 
53.848,  52.576,  53.424,  53.848,  52.576,  53.848,  52.576, 
53.848,  52.576,  53.848,  52.576,  53.848,  52.576,  52.576, 
52.576]) 
zz=np.array([ 4.936 ,  5.4296,  5.4296,  5.9232,  5.9232,  6.4168,  6.4168, 
6.9104,  6.9104,  7.404 ,  7.404 ,  7.404 ,  7.404 ,  7.404 , 
7.404 ,  7.8976,  7.8976,  7.8976,  8.3912,  8.3912,  8.3912, 
8.3912,  8.8848,  8.8848,  8.8848,  8.8848,  9.3784,  9.3784, 
9.872 ]) 
 
 
def fun(p,xx,yy,zz): 
    distance=[]     
    v0 = np.array([p[0], p[2], 0]); v1 = np.array([p[1],p[3], 1]) 
    def funA(v0,v1,xx,yy,zz):         
        for point in range(len(xx)): 
            pp = np.array([xx[point], yy[point], zz[point]]) 
            yield pp,v0,v1 
    pool = multiprocessing.Pool() 
    distance.append(pool.starmap(funB, funA(v0,v1,xx,yy,zz))) 
    return distance 
 
def funB(pp, v0,v1): 
        RunDistance=(np.linalg.norm(np.cross(pp-v0,v1))/np.linalg.norm(v1)) 
        return RunDistance 
 
result,cov,infodict,mesg,ier = leastsq(fun,p, args=(xx,yy,zz), Dfun=None, full_output=True, col_deriv=0, ftol=1.49012e-08, xtol=1.49012e-08, gtol=0.0, epsfcn=None, factor=100, diag=None) 

--- 我得到的错误是:

TypeError Traceback(最后一次调用) 在 () 37 返回运行距离 38 ---> 39 result,cov,infodict,mesg,ier = leastsq(fun,p,args=(xx,yy,zz), Dfun=None, full_output=True, col_deriv=0, ftol=1.49012e-08, xtol=1.49012e-08, gtol=0.0, epsfcn=None, factor=100, diag=None)

/usr/local/lib/python3.6/site-packages/scipy/optimize/minpack.py in leastsq(func, x0, args, Dfun, full_output, col_deriv, ftol, xtol, gtol, maxfev, epsfcn,因素,诊断) 378 米 = 形状 [0] 379 如果 n > m: --> 380 raise TypeError('不正确的输入:N=%s 不能超过 M=%s' % (n, m)) 381 如果 epsfcn 为无: 第382章

TypeError: 不正确的输入:N=4 不能超过 M=1


无需多处理的有趣函数

def fun(p,xx,yy,zz): 
    distance=[] #distance initialized 
    v0 = np.array([p[0], p[2], 0]); v1 = np.array([p[1],p[3], 1]) #3D line parametric equation 
 
    for point in range(len(xx)): #for loop over all the x/y positions inside track    
        pp = np.array([xx[point], yy[point], zz[point]]) # 1 3D point 
        distance.append((np.linalg.norm(np.cross(pp-v0,v1))/np.linalg.norm(v1))) #* fxfy   #check references at bottom of file for equation explanation    
 
    return distance  

请您参考如下方法:

为了回答我自己的问题,问题是示例创建了一个嵌套列表,因此 len(distance) = 1。通过放置修复:

return distance[0] 

现在的错误是 OSError: [Errno 24] Too many open files

也可以通过从此处更改/Library/LaunchDaemons/limit.maxfiles.plist 来解决:https://github.com/ansible/ansible/issues/12259


当前错误:

---> 67         self.pid = os.fork() 
     68         if self.pid == 0: 
     69             try: 
 
BlockingIOError: [Errno 35] Resource temporarily unavailable