Skip to main content

First N of Total batchTriggerAndWait

Add the ability to complete a batch after N of the runs in the batch have completed, cancelling the incomplete runs. This would allow parallelizing multiple LLM calls and completing once one or more have completed, and stopping work on the others, to get back multiple results faster.

No comments yet

Be the first to share your thoughts.