batch.triggerAndWaitAny()

This is the equivalent of Promise.any()

In my particular case I have an ML model that I want to have run on the CPU (slower but more stable) and also on the GPU (faster but more prone to failure). I have two separate Replicate endpoints (one runs on the CPU, the other on the GPU). I want to run these in parallel and await the first successful result.

Upvoters
Status

In Review

Board

πŸ’‘ Feature Request

Date

About 1 year ago

Author

dmabuff

Subscribe to post

Get notified by email when there are changes.