First N of Total batchTriggerAndWait

Add the ability to complete a batch after N of the runs in the batch have completed, cancelling the incomplete runs. This would allow parallelizing multiple LLM calls and completing once one or more have completed, and stopping work on the others, to get back multiple results faster.

Upvoters
Status

In Review

Board

💡 Feature Request

Date

Over 1 year ago

Author

Eric Allam

Subscribe to request

Get notified by email when there are changes.