如果ThreadPoolExecutor中的一个任务可以引发异常,如何结束其中的所有任务
问题描述
我有一项任务要完成:
def task(body):
# some logic that which can throw an exception
# if something goes wrong
do_task(body)
并且此任务中的逻辑可能引发异常
我有Execute方法和Executor:
def execute():
executor = ThreadPoolExecutor(max_workers=4)
future1 = executor.submit(task, body1)
future2 = executor.submit(task, body2)
future3 = executor.submit(task, body3)
future4 = executor.submit(task, body4)
result1 = future1.result()
result2 = future2.result()
result3 = future3.result()
result4 = future4.result()
我希望如果至少有一个任务崩溃--不要等到其他任务完成后才停止一切。我如何才能正确执行此操作?
解决方案
若要在某个任务引发时放弃等待其他任务,可以使用带有FIRST_EXCEPTION
标志的concurrent.futures.wait()
:
def execute():
executor = ThreadPoolExecutor(max_workers=4)
future1 = executor.submit(task, body1)
future2 = executor.submit(task, body2)
future3 = executor.submit(task, body3)
future4 = executor.submit(task, body4)
done, not_done = concurrent.futures.wait(
[future1, future2, future3, future4],
return_when=concurrent.futures.FIRST_EXCEPTION
)
if not_done:
# at least one future has raised - you can return here
# or propagate the exception
#list(not_done)[0].result() # re-raises exception here
return # ignores exception and returns
result1 = future1.result()
result2 = future2.result()
result3 = future3.result()
result4 = future4.result()
...
请注意,其余任务仍将在后台运行。没有办法强行阻止他们。
相关文章