Skip to main content
 首页 » 编程设计

python之如何获得工作结果 disco python

2025年02月15日10开发

如何从 disco python 获取工作结果?

我尝试过迪斯科工作:

jmunsch@disco-master-5147:~$ disco jobs 
KeyCount@5ca:2d323:53093 
KeyCount@5ca:2bcb5:4f479 

迪斯科结果:

jmunsch@disco-master-5147:~$ disco results "KeyCount@5ca:2bcb5:4f479" 
dir://disco-node-9144/disco/disco-node-9144/1a/KeyCount@5ca:2bcb5:4f479/.disco/reduce-1001-1482183896238504.results 

这里是输入:

jmunsch@disco-master-5147:~$ disco jobdict "KeyCount@5ca:2bcb5:4f479" 
inputs  [ ... a bunch of inputs ... ] 
pipeline    [[u'iter_pgs_item', u'split', False], [u'reduce', u'group_label', False]] 
save_info   ddfs 
worker  virtualenvworker 
save_results    False 
prefix  KeyCount 
scheduler   {} 
owner   jenkins@jenkins-4139 

相关:

请您参考如下方法:

我打开了一个 pull request,但基本上这是一种方法,我想将 reduce 结果流出为 len(2) 元组,作为 bin/discocli.py 的一部分:

@Disco.job_command 
def results_get(program, jobname): 
    """Usage: jobname 
 
    Print out the data of a completed job. 
    `disco jobs | xargs -IJOB_ID disco results_get JOB_ID` 
    """ 
    status, results = program.disco.results(jobname) 
    if sys.version_info[0] == 2: 
        binary_type = str 
    elif sys.version_info[0] == 3: 
        binary_type = bytes 
    if status == 'ready': 
        for line in program.disco.result_iterator(results): 
            if isinstance(line, binary_type): 
                line = line.decode('utf-8') 
            print(line) 

参见: