Add the ability to complete a batch after N of the runs in the batch have completed, cancelling the incomplete runs. This would allow parallelizing multiple LLM calls and completing once one or more have completed, and stopping work on the others, to get back multiple results faster.
In Review
π‘ Feature Request
8 months ago

Eric Allam
Get notified by email when there are changes.
In Review
π‘ Feature Request
8 months ago

Eric Allam
Get notified by email when there are changes.