I’m thinking about starting a self hosting setup, and my first thought was to install k8s (k3s probably) and containerise everything.
But I see most people on here seem to recommend virtualizing everything with proxmox.
What are the benefits of using VMs/proxmox over containers/k8s?
Or really I’m more interested in the reverse, are there reasons not to just run everything with k8s as the base layer? Since it’s more relevant to my actual job, I’d lean towards ramping up on k8s unless there’s a compelling reason not to.
Virtualization is not about different architectures, quite the opposite. Emulation allows you to run different architectures, virtualization is locked to the underlying architecture.
While spinning up a VM per app is wasteful, there are advantages to using a VM to host your containers, instead of hosting them directly on Proxmox. For example, you will most likely add things around the docker infrastructure, and backing up a VM (containing all that) is easier than backing up a physical host.