Runners should be capable of chunked upload. #5078

New issue

Open

opened 2026-02-22 11:02:09 -05:00 by deekerman · 1 comment

deekerman commented

2026-02-22 11:02:09 -05:00

Owner

Originally created by @Kinuseka on GitHub (Jul 13, 2023).

Describe the problem to be solved

When a runner finishes its job it uploads back its file contents to the main server, however this non chunked format might pose issues to specific environment especially those behind a cloudflare proxy.

Instances running behind cloudflare might have issues with runners sending files back to the main server due to upload limitation on free tier locked to 100MB per connection (200MB pro, 512MB enterprise) which will return 413 error if the request had exceeded that amount.

Describe the solution you would like

The solution is that peertube runner should not upload the file in one connection and should be able to upload them in chunks.

Although this solution is not only limited to just solving cloudflare alone, it could also make runners robust to connection errors by simply retrying that chunk again if it ever there are some connection issues.

Originally created by @Kinuseka on GitHub (Jul 13, 2023). ### Describe the problem to be solved When a runner finishes its job it uploads back its file contents to the main server, however this non chunked format might pose issues to specific environment especially those behind a cloudflare proxy. Instances running behind cloudflare might have issues with runners sending files back to the main server due to upload limitation on free tier locked to 100MB per connection (200MB pro, 512MB enterprise) which will return 413 error if the request had exceeded that amount. ### Describe the solution you would like The solution is that peertube runner should not upload the file in one connection and should be able to upload them in chunks. Although this solution is not only limited to just solving cloudflare alone, it could also make runners robust to connection errors by simply retrying that chunk again if it ever there are some connection issues.

deekerman added the

Type: Feature Request ✨

Component: Runners

labels

2026-02-22 11:02:09 -05:00

deekerman commented

2026-02-22 11:02:21 -05:00

Author

Owner

@alvensleben commented on GitHub (Oct 15, 2024):

Are there any updates on this feature? I'm currently facing an issue with peertube-runner and Cloudflare, I have to disable the protection in case I use remote transcoding. The main server won't be able to handle the load, unfortunately. I can't come up with a proper solution (I can't just disable Cloudflare's protection fully, I need it).

@alvensleben commented on GitHub (Oct 15, 2024): Are there any updates on this feature? I'm currently facing an issue with peertube-runner and Cloudflare, I have to disable the protection in case I use remote transcoding. The main server won't be able to handle the load, unfortunately. I can't come up with a proper solution (I can't just disable Cloudflare's protection fully, I need it).