←back to thread

221 points finnlab | 4 comments | | HN request time: 0.705s | source
1. Youden ◴[] No.43545629[source]
I've been through just about everything to get where I am and I've ended up with Hashicorp Nomad and Consul with Traefik, managed by OpenTofu (open-source Terraform).

Things that haven't worked for me:

- Standalone Docker: Doesn't work great on its own. Containers often need to be recreated to modify immutable properties, like the specific image the container is running. To recreate the container, you need to store some state about how it _should_ work elsewhere.

- Quadlet: Too hard to manage clusters of services. Podman has subtle differences to Docker that occasionally cause problems and really tempting features (e.g. rootless) that cause more problems if you try to use them.

- Kubernetes: Waaaay too heavy. Even the "lightweight" distributions like k3s, k0s etc. embed large components of the official distribution, which are still heavy. Part of the embedded metric server for example periodically enumerates every single open file handle in every container. This leads to huge CPU spikes for a feature I don't care about.

With my setup now, I can more or less copy-paste a template into a new file, tweak some strings and have a HTTPS-enabled service available at https://thing.mydomain.mine. This works pretty painlessly even for services that need several volumes to maintain state or need several containers that work together.

replies(2): >>43545658 #>>43545666 #
2. JojoFatsani ◴[] No.43545658[source]
Docker Compose is very suitable for the homelab scenario. I use it on my pi.
3. quickslowdown ◴[] No.43545666[source]
Do you run a Nomad cluster? Or just on a single host? This is my desired state, I've set up Nomad a number of times but always get stuck in one place or another. I've gotten much further with Nomad than Kubernetes, but I've kind of always gone back to ol' faithful, writing a docker compose file and running everything that way.
replies(1): >>43555894 #
4. Youden ◴[] No.43555894[source]
Just a single host. The main thing that I couldn't figure out is how to turn off "bootstrap" mode, so I've just left it on.