Skip to main content

Shared storage between workers for large file processing

Feature Request

Add shared storage or memory between workers to enable parallel processing of large files without requiring each worker to download the entire file from object storage. This would significantly speed up workflows like video processing where a single large file needs to be split and processed across multiple workers.

Posted by Iss Haddad ·
1 comment

Comments1

  • An Anonymous User

    •

    Mar 24

    Bite market from Render and Railway.
    We’d like to generate a software project in multisteps and could use a shared place for code.