The networking setup is due an overhaul so this page will change quite a bit over the next year.
Virgin Media, 340 down and 35 up.
I run opnsense in a baremetal Dell R310.
- Net in via 1g from modem.
- Net out via 10g to Mikrotik 10g switch which routes to all 3 hypervisors.
- Net out via 1g to Ubiquiti WiFi and home computers.
The sucky part here is that I currently run a bridge between 1 & 10g which is far from optimal. I also haven't yet setup VLans which is on the to-do list.
Several backup Mellanox 10g cards and spare cables ensure redundancy. If the 10g switch was to fail (currently) I'd have to swap over to 1g cables - I'm planning on setting up automatic failover to 1g just in case.
Each server is setup with Dell enterprise iDracs to allow remote admin of the servers themselves, these are secured with certs signed by my own CA and limited to local network access.