←back to thread

23 points wkoszek | 4 comments | | HN request time: 0.001s | source

I built bsub because I was tired of wiring up Docker images, Python environments, GPUs, sandboxing, and resource limits every time I needed to run heavy command-line tools from web apps. I wanted: send files -> run job in the cloud -> get output -> done.

https://www.bsub.io

bsub lets you execute tools like Whisper, Typst, Pandoc, Docling, and FFmpeg as remote batch jobs with no environment setup. You can try them locally via the CLI or integrate via a simple REST API.

Example (PDF extraction):

  bsubio submit -w pdf/extract *.pdf
Works like running the tool locally, but the compute and isolation happen in the cloud.

Technical details: - Each job runs in an isolated container with defined CPU/GPU/RAM limits. - Files are stored ephemerally for the duration of the job and deleted after completion. - REST API returns job status, logs, and results. - Cold start for light processors (Typst, Pandoc) is low; Whisper/FFmpeg take longer due to model load/encoding time. - Backend scales horizontally; more workers can be added during load spikes.

Current processors:

  SST/Whisper -- speech-to-text

  Typography -- Typst, Pandoc

  PDF extraction -- Docling

  Video transcoding -- FFmpeg
More coming; suggestions welcome for tools that are painful to set up locally.

Looking for testers! CLI is open source: https://github.com/bsubio/cli. Installers available for Linux/macOS; Windows testing is in progress. Free during early testing; pricing TBD.

If you’re on Windows, feedback is especially helpful: contact@bsub.io

If you try it, I’d appreciate feedback on API design, latency, missing processors, or anything rough around the edges.

1. windexh8er ◴[] No.45961398[source]
Looks cool. Also looks like it's not self-hostable. Is that correct? For a tool like this I want to deploy it where I need it and (at least for me) a SaaS option is a deal breaker.

The only thing I've found similar to this as of late is AutoKitteh [0]. This looks like it is somewhat in the same competitive space, but with less features / flexibility. How would you say you compare and did it not fulfill the problem you originally had?

[0] https://autokitteh.com/

replies(1): >>45970794 #
2. wkoszek ◴[] No.45970794[source]
It's not self-hostable yet: I'm thinking about adding this option. I think for now I'm trying to see if people would like to give it a shot and try it out.

Why do you think it's a deal breaker for you?

replies(1): >>45974789 #
3. windexh8er ◴[] No.45974789[source]
Because when I'm running infra just to manage scripts for me I want them in proximity to other apps or services I'm already running. There's very few SaaS that will offer a way to connect privately (e.g. Tailscale).

Ultimately I want this in my stack. Autokitteh let's me do it my way, so this is a deal breaker for me. I also don't want to get stuck in SaaS only to have it enshittififed in a few years.

replies(1): >>45975775 #
4. wkoszek ◴[] No.45975775{3}[source]
Sounds good. bsub.io will offer a way to be self-hosted 100% offline too. Just not now. That will require some work.