Network Bonds Configuration

Bond Overview

Bond	NICs	Speed	VLAN	Purpose
bond0	nic2, nic3	2x 1G	10	Management
bond1	nic5, nic6	2x 25G	20	Storage
bond2	nic1, nic4	2x 10G	30+	VM Traffic

/etc/network/interfaces (srv-pve-zrh-01)

# Management Bond (1G)
auto bond0
iface bond0 inet manual
    bond-slaves nic2 nic3
    bond-mode 802.3ad
    bond-miimon 100
    bond-xmit-hash-policy layer3+4

auto vmbr0
iface vmbr0 inet static
    address 10.10.10.11/24
    gateway 10.10.10.1
    bridge-ports bond0
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094

# Storage Bond (25G)
auto bond1
iface bond1 inet manual
    bond-slaves nic5 nic6
    bond-mode 802.3ad
    bond-miimon 100
    bond-xmit-hash-policy layer3+4
    mtu 9000

auto vmbr1
iface vmbr1 inet static
    address 10.20.20.11/24
    bridge-ports bond1
    bridge-stp off
    bridge-fd 0
    mtu 9000

# VM Traffic Bond (10G)
auto bond2
iface bond2 inet manual
    bond-slaves nic1 nic4
    bond-mode 802.3ad
    bond-miimon 100
    bond-xmit-hash-policy layer3+4

NIC Details

Intel I210 (Management)

Speed: 1 Gbit/s
Ports: 2x 1GbE RJ45
Use: Management (bond0)

Mellanox ConnectX-6 Dx (Storage)

Speed: 25 Gbit/s per Port
Ports: 2x 25GbE SFP28
Driver: mlx5_core (native kernel)
Firmware: 22.36.1010
Features: RDMA/RoCE capable
Use: Storage Network (bond1)

Intel X710 (VM Traffic)

Speed: 10 Gbit/s Full-Duplex
Ports: 2x 10GBASE-T (RJ45)
Use: VM Traffic (bond2)

Bond Status Commands

# Bond status
cat /proc/net/bonding/bond0
cat /proc/net/bonding/bond1
cat /proc/net/bonding/bond2

# NIC stats
ethtool nic1
ethtool -S nic5  # Mellanox detailed stats

# LACP status (from switch perspective)
# UniFi: show lacp internal