Skip to main content
 首页 » 编程设计

python之键盘中断与 python 的多处理池 imap

2024年08月27日2952php

遵循这个问题中的一些建议 Keyboard Interrupts with python's multiprocessing Pool ,我写的测试代码命名为test.py

from multiprocessing import Pool 
from multiprocessing.pool import IMapIterator 
import fileinput 
 
def wrapper(func): 
  def wrap(self, timeout=None): 
  # Note: the timeout of 1 googol seconds introduces a rather subtle 
  # bug for Python scripts intended to run many times the age of the universe. 
  return func(self, timeout=timeout if timeout is not None else 1e100) 
return wrap 
IMapIterator.next = wrapper(IMapIterator.next) 
 
def main(): 
    p = Pool(1) 
    try: 
        for _ in p.imap(worker, fileinput.input(), 1): 
            pass 
    except KeyboardInterrupt: 
        p.terminate() 
 
def worker(line): 
    print line 
 
if __name__ == '__main__': 
    main() 

当我在终端运行 python test.py 时:

python test.py 

我仍然得到 KeyboardInterrupt 回溯,而且我必须发送 Ctrl^C 两次来停止脚本。我如何处理 KeyboardInterrupt 并让它不打印 tarceback 而只使用一次 Ctrl^c 来优雅地停止它。

^CProcess PoolWorker-1: 
Traceback (most recent call last): 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
KeyboardInterrupt 
^CTraceback (most recent call last): 
File "test.py", line 27, in <module> 
    main() 
File "test.py", line 21, in main 
    p.terminate() 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/pool.py", line 452, in terminate 
    self._worker_handler._state = TERMINATE 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/util.py", line 201, in __call__ 
    res = self._callback(*self._args, **self._kwargs) 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/pool.py", line 504, in _terminate_pool 
    if threading.current_thread() is not task_handler: 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py", line 958, in join 
    self.__block.wait(delay) 
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py", line 358, in wait 
    _sleep(delay) 
KeyboardInterrupt 

请您参考如下方法:

查看标准库中包含的信号模块。您可以在主进程中注册信号处理程序

from signal import * 
 
def siginthndlr(sig, frame): 
    '''do what you need here''' 
    print "Keyboard interrupt catched" 
 
signal(SIGINT, siginthndlr) #Register SIGINT handler function 

这将优雅地杀死工作进程而不是杀死主进程。