Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.158

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=432 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 431.804/431.804/431.804/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.1.158

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 51366 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 51374 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 51376 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 51388 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 51398 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 51402 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 51410 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 51412 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 51424 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 51436 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  8.15 MBytes  68.4 Mbits/sec   90    139 KBytes
[  7]   0.00-1.00   sec  8.01 MBytes  67.2 Mbits/sec   50    182 KBytes
[  9]   0.00-1.00   sec  7.45 MBytes  62.5 Mbits/sec   89   87.7 KBytes
[ 11]   0.00-1.00   sec  7.97 MBytes  66.8 Mbits/sec    9    134 KBytes
[ 13]   0.00-1.00   sec  7.91 MBytes  66.4 Mbits/sec   56    123 KBytes
[ 15]   0.00-1.00   sec  7.86 MBytes  65.9 Mbits/sec   90    140 KBytes
[ 17]   0.00-1.00   sec  7.74 MBytes  64.9 Mbits/sec   42    171 KBytes
[ 19]   0.00-1.00   sec  7.87 MBytes  66.0 Mbits/sec   45    185 KBytes
[ 21]   0.00-1.00   sec  7.18 MBytes  60.3 Mbits/sec   45    158 KBytes
[ 23]   0.00-1.00   sec  6.71 MBytes  56.3 Mbits/sec   79    115 KBytes
[SUM]   0.00-1.00   sec  76.8 MBytes   645 Mbits/sec  595
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  6.34 MBytes  53.2 Mbits/sec    0    163 KBytes
[  7]   1.00-2.00   sec  5.84 MBytes  49.0 Mbits/sec   39   72.1 KBytes
[  9]   1.00-2.00   sec  4.78 MBytes  40.1 Mbits/sec    4   83.4 KBytes
[ 11]   1.00-2.00   sec  5.59 MBytes  46.9 Mbits/sec   67   77.8 KBytes
[ 13]   1.00-2.00   sec  5.03 MBytes  42.2 Mbits/sec   27   74.9 KBytes
[ 15]   1.00-2.00   sec  5.16 MBytes  43.3 Mbits/sec   30   55.1 KBytes
[ 17]   1.00-2.00   sec  6.52 MBytes  54.7 Mbits/sec   45    140 KBytes
[ 19]   1.00-2.00   sec  6.77 MBytes  56.8 Mbits/sec    0    221 KBytes
[ 21]   1.00-2.00   sec  5.72 MBytes  48.0 Mbits/sec   21   87.7 KBytes
[ 23]   1.00-2.00   sec  4.97 MBytes  41.7 Mbits/sec   35    100 KBytes
[SUM]   1.00-2.00   sec  56.7 MBytes   476 Mbits/sec  268
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  27.3 MBytes   229 Mbits/sec   45    181 KBytes
[  7]   2.00-3.00   sec  21.8 MBytes   183 Mbits/sec   41    140 KBytes
[  9]   2.00-3.00   sec  22.4 MBytes   188 Mbits/sec   44    141 KBytes
[ 11]   2.00-3.00   sec  21.9 MBytes   184 Mbits/sec    0    197 KBytes
[ 13]   2.00-3.00   sec  22.2 MBytes   187 Mbits/sec    0    195 KBytes
[ 15]   2.00-3.00   sec  21.3 MBytes   179 Mbits/sec    0    181 KBytes
[ 17]   2.00-3.00   sec  26.0 MBytes   218 Mbits/sec   45    171 KBytes
[ 19]   2.00-3.00   sec  28.3 MBytes   238 Mbits/sec   45    197 KBytes
[ 21]   2.00-3.00   sec  22.7 MBytes   190 Mbits/sec   45    144 KBytes
[ 23]   2.00-3.00   sec  23.4 MBytes   197 Mbits/sec   45    151 KBytes
[SUM]   2.00-3.00   sec   237 MBytes  1.99 Gbits/sec  310
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  25.9 MBytes   217 Mbits/sec   45    177 KBytes
[  7]   3.00-4.00   sec  25.2 MBytes   211 Mbits/sec    0    225 KBytes
[  9]   3.00-4.00   sec  25.4 MBytes   213 Mbits/sec   45    157 KBytes
[ 11]   3.00-4.00   sec  26.2 MBytes   219 Mbits/sec   45    181 KBytes
[ 13]   3.00-4.00   sec  26.3 MBytes   220 Mbits/sec   45    180 KBytes
[ 15]   3.00-4.00   sec  25.2 MBytes   212 Mbits/sec   49    123 KBytes
[ 17]   3.00-4.00   sec  25.4 MBytes   213 Mbits/sec   68    171 KBytes
[ 19]   3.00-4.00   sec  25.8 MBytes   216 Mbits/sec   75    181 KBytes
[ 21]   3.00-4.00   sec  24.6 MBytes   206 Mbits/sec   54    158 KBytes
[ 23]   3.00-4.00   sec  24.3 MBytes   204 Mbits/sec   55    127 KBytes
[SUM]   3.00-4.00   sec   254 MBytes  2.13 Gbits/sec  481
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  25.2 MBytes   212 Mbits/sec   45    188 KBytes
[  7]   4.00-5.00   sec  26.0 MBytes   218 Mbits/sec    0    266 KBytes
[  9]   4.00-5.00   sec  24.7 MBytes   207 Mbits/sec   45    178 KBytes
[ 11]   4.00-5.00   sec  25.4 MBytes   213 Mbits/sec    0    255 KBytes
[ 13]   4.00-5.00   sec  24.9 MBytes   209 Mbits/sec   45    185 KBytes
[ 15]   4.00-5.00   sec  24.9 MBytes   209 Mbits/sec   45    182 KBytes
[ 17]   4.00-5.00   sec  25.3 MBytes   212 Mbits/sec    0    249 KBytes
[ 19]   4.00-5.00   sec  25.0 MBytes   210 Mbits/sec   17    188 KBytes
[ 21]   4.00-5.00   sec  24.8 MBytes   208 Mbits/sec    0    240 KBytes
[ 23]   4.00-5.00   sec  25.2 MBytes   211 Mbits/sec   38    178 KBytes
[SUM]   4.00-5.00   sec   251 MBytes  2.11 Gbits/sec  235
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec  93.0 MBytes   156 Mbits/sec  225             sender
[  5]   0.00-5.01   sec  91.7 MBytes   154 Mbits/sec                  receiver
[  7]   0.00-5.00   sec  86.8 MBytes   146 Mbits/sec  130             sender
[  7]   0.00-5.01   sec  85.4 MBytes   143 Mbits/sec                  receiver
[  9]   0.00-5.00   sec  84.8 MBytes   142 Mbits/sec  227             sender
[  9]   0.00-5.01   sec  83.7 MBytes   140 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec  87.1 MBytes   146 Mbits/sec  121             sender
[ 11]   0.00-5.01   sec  86.0 MBytes   144 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec  86.4 MBytes   145 Mbits/sec  173             sender
[ 13]   0.00-5.01   sec  85.1 MBytes   143 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec  84.4 MBytes   142 Mbits/sec  214             sender
[ 15]   0.00-5.01   sec  83.4 MBytes   140 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec  90.9 MBytes   152 Mbits/sec  200             sender
[ 17]   0.00-5.01   sec  89.8 MBytes   150 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec  93.8 MBytes   157 Mbits/sec  182             sender
[ 19]   0.00-5.01   sec  92.4 MBytes   155 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec  85.0 MBytes   143 Mbits/sec  165             sender
[ 21]   0.00-5.01   sec  84.1 MBytes   141 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec  84.6 MBytes   142 Mbits/sec  252             sender
[ 23]   0.00-5.01   sec  83.4 MBytes   140 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec   877 MBytes  1.47 Gbits/sec  1889             sender
[SUM]   0.00-5.01   sec   865 MBytes  1.45 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
-----------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets  Tx Bytes   Tx Errors
-----------------------------------------------------------------------------
eth0  up        106269   7031943          0      628581  951605363          0
eth1  up             0         0          0           0          0          0
eth2  down           0         0          0           0          0          0
eth3  down           0         0          0           0          0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.158

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.296 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.1.158

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 54542 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 54550 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 54556 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 54558 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 54564 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 54566 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 54568 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 54582 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 54584 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 54596 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  26.9 MBytes   225 Mbits/sec    0    512 KBytes
[  7]   0.00-1.00   sec  25.0 MBytes   210 Mbits/sec    0    458 KBytes
[  9]   0.00-1.00   sec  25.0 MBytes   210 Mbits/sec    1   1.41 KBytes
[ 11]   0.00-1.00   sec  22.2 MBytes   186 Mbits/sec    0    402 KBytes
[ 13]   0.00-1.00   sec  24.1 MBytes   202 Mbits/sec    1   1.41 KBytes
[ 15]   0.00-1.00   sec  22.4 MBytes   188 Mbits/sec    0    404 KBytes
[ 17]   0.00-1.00   sec  18.7 MBytes   157 Mbits/sec    1   1.41 KBytes
[ 19]   0.00-1.00   sec  19.4 MBytes   163 Mbits/sec    0    363 KBytes
[ 21]   0.00-1.00   sec  19.9 MBytes   167 Mbits/sec    1   1.41 KBytes
[ 23]   0.00-1.00   sec  17.3 MBytes   145 Mbits/sec    1   1.41 KBytes
[SUM]   0.00-1.00   sec   221 MBytes  1.85 Gbits/sec    5
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  29.0 MBytes   243 Mbits/sec    1    537 KBytes
[  7]   1.00-2.00   sec  28.2 MBytes   236 Mbits/sec    1    479 KBytes
[  9]   1.00-2.00   sec  28.3 MBytes   238 Mbits/sec    0    495 KBytes
[ 11]   1.00-2.00   sec  28.8 MBytes   242 Mbits/sec    1    420 KBytes
[ 13]   1.00-2.00   sec  28.2 MBytes   236 Mbits/sec    0    510 KBytes
[ 15]   1.00-2.00   sec  28.4 MBytes   238 Mbits/sec    1    468 KBytes
[ 17]   1.00-2.00   sec  28.1 MBytes   236 Mbits/sec    0    444 KBytes
[ 19]   1.00-2.00   sec  29.3 MBytes   246 Mbits/sec    1    441 KBytes
[ 21]   1.00-2.00   sec  28.8 MBytes   241 Mbits/sec    0    464 KBytes
[ 23]   1.00-2.00   sec  28.0 MBytes   235 Mbits/sec    0    461 KBytes
[SUM]   1.00-2.00   sec   285 MBytes  2.39 Gbits/sec    5
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  32.8 MBytes   275 Mbits/sec  180    416 KBytes
[  7]   2.00-3.00   sec  31.6 MBytes   265 Mbits/sec  270    379 KBytes
[  9]   2.00-3.00   sec  28.8 MBytes   241 Mbits/sec  202    294 KBytes
[ 11]   2.00-3.00   sec  31.0 MBytes   260 Mbits/sec  127    349 KBytes
[ 13]   2.00-3.00   sec  29.1 MBytes   244 Mbits/sec   96    293 KBytes
[ 15]   2.00-3.00   sec  31.9 MBytes   267 Mbits/sec  207    373 KBytes
[ 17]   2.00-3.00   sec  30.6 MBytes   257 Mbits/sec  237    392 KBytes
[ 19]   2.00-3.00   sec  31.1 MBytes   261 Mbits/sec   96    369 KBytes
[ 21]   2.00-3.00   sec  30.9 MBytes   260 Mbits/sec  253    402 KBytes
[ 23]   2.00-3.00   sec  30.8 MBytes   259 Mbits/sec  256    396 KBytes
[SUM]   2.00-3.00   sec   309 MBytes  2.59 Gbits/sec  1924
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  30.3 MBytes   254 Mbits/sec    0    464 KBytes
[  7]   3.00-4.00   sec  25.8 MBytes   216 Mbits/sec    5    307 KBytes
[  9]   3.00-4.00   sec  26.5 MBytes   223 Mbits/sec    0    331 KBytes
[ 11]   3.00-4.00   sec  25.6 MBytes   215 Mbits/sec    5    294 KBytes
[ 13]   3.00-4.00   sec  22.6 MBytes   189 Mbits/sec   45    253 KBytes
[ 15]   3.00-4.00   sec  27.7 MBytes   232 Mbits/sec    0    410 KBytes
[ 17]   3.00-4.00   sec  25.0 MBytes   210 Mbits/sec    9    317 KBytes
[ 19]   3.00-4.00   sec  26.8 MBytes   225 Mbits/sec    0    410 KBytes
[ 21]   3.00-4.00   sec  24.0 MBytes   201 Mbits/sec   53    293 KBytes
[ 23]   3.00-4.00   sec  27.3 MBytes   229 Mbits/sec    0    450 KBytes
[SUM]   3.00-4.00   sec   262 MBytes  2.19 Gbits/sec  117
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  29.7 MBytes   249 Mbits/sec   13    257 KBytes
[  7]   4.00-5.00   sec  28.5 MBytes   239 Mbits/sec   44    242 KBytes
[  9]   4.00-5.00   sec  25.5 MBytes   214 Mbits/sec   12    252 KBytes
[ 11]   4.00-5.00   sec  30.4 MBytes   255 Mbits/sec    0    327 KBytes
[ 13]   4.00-5.00   sec  24.8 MBytes   208 Mbits/sec   16    219 KBytes
[ 15]   4.00-5.00   sec  30.4 MBytes   255 Mbits/sec    0    447 KBytes
[ 17]   4.00-5.00   sec  27.1 MBytes   227 Mbits/sec    0    335 KBytes
[ 19]   4.00-5.00   sec  30.6 MBytes   256 Mbits/sec   45    314 KBytes
[ 21]   4.00-5.00   sec  24.9 MBytes   209 Mbits/sec   90    233 KBytes
[ 23]   4.00-5.00   sec  26.8 MBytes   225 Mbits/sec  135    273 KBytes
[SUM]   4.00-5.00   sec   279 MBytes  2.34 Gbits/sec  355
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   149 MBytes   250 Mbits/sec  194             sender
[  5]   0.00-5.01   sec   146 MBytes   245 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   139 MBytes   233 Mbits/sec  320             sender
[  7]   0.00-5.01   sec   137 MBytes   230 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   134 MBytes   225 Mbits/sec  215             sender
[  9]   0.00-5.01   sec   132 MBytes   221 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   138 MBytes   232 Mbits/sec  133             sender
[ 11]   0.00-5.01   sec   136 MBytes   227 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   129 MBytes   216 Mbits/sec  158             sender
[ 13]   0.00-5.01   sec   126 MBytes   211 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   141 MBytes   236 Mbits/sec  208             sender
[ 15]   0.00-5.01   sec   139 MBytes   233 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   130 MBytes   217 Mbits/sec  247             sender
[ 17]   0.00-5.01   sec   127 MBytes   213 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   137 MBytes   230 Mbits/sec  142             sender
[ 19]   0.00-5.01   sec   135 MBytes   226 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   128 MBytes   216 Mbits/sec  397             sender
[ 21]   0.00-5.01   sec   126 MBytes   211 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   130 MBytes   219 Mbits/sec  392             sender
[ 23]   0.00-5.01   sec   128 MBytes   215 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.32 GBytes  2.27 Gbits/sec  2406             sender
[SUM]   0.00-5.01   sec  1.30 GBytes  2.23 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
-----------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets  Tx Bytes   Tx Errors
-----------------------------------------------------------------------------
eth0  up        100205   6623830          0      503680  762483405          0
eth1  up        106571   7036204          0      465040  703959252          0
eth2  down           0         0          0           0          0          0
eth3  down           0         0          0           0          0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.