my boss asked me for a recommended infrastructure hosting kubelets and storage.
As i understand it kubernetes is optimized for IaaS where the management of hosts and storage is only a click away. But the idea of introducing an IaaS to just provide for k8s seems overcomplicating things. Also it removes a lot of computing performance by adding another abstraction layer and virtual machines.
We want to host kubernetes on bare-metal-servers. This introduces the problem of provisioned storage which needs to be available on all hosts. Our preferred setup for this would be a SAN attached via fibre channel and on block-level available to all servers. Unfortunately we have not found a working provisioning solution for this type of storage, so we ended up in a dead end here.
My question is: has anyone a reliable setup for hosting k8s on bare-metal and having storage dynamic provisioned, which enables all pods to seamlessly switch kubelets?
Is our approach naive or somehow not recommended to follow?
Thanks in advance for any advice.