incus-deploy: Full run, working out of the box

by stgraber
GNU/Linux ◆ xterm ◆ bash 1529 views

This is a full run using the Incus deployment tooling from https://github.com/stgraber/incus-deploy

The first step is using Terraform to create a set of VMs to act as stand-ins for a set of real servers. Each of those VM has 2 networks, one for host networking and one for ingress into OVN. They also all have 5 disks attached to them, 3 for use by Ceph and 2 for use by local storage.

The second step is to use Ansible to actually deploy Ceph, OVN and Incus across the 5 servers. This properly sets up Ceph by generating and distributing all applicable keyrings, generates ceph.conf, … Same goes for OVN where it generates a local PKI to issue certificates for all servers participating in OVN and then configures all the daemons. Finally, Incus itself gets installed and configured to use both Ceph and OVN, automatically create and assemble a cluster with all 5 servers and sets up the default profile to use Ceph and OVN.

At the end we can see the fully functional cluster and throw some instances at it.