Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=472 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 471.559/471.559/471.559/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 37064 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 37066 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 37076 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 37092 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 37100 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 37102 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 37106 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 37116 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 37132 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 37134 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  25.3 MBytes   213 Mbits/sec    0    337 KBytes
[  7]   0.00-1.00   sec  24.8 MBytes   208 Mbits/sec    0    337 KBytes
[  9]   0.00-1.00   sec  23.5 MBytes   197 Mbits/sec    0    341 KBytes
[ 11]   0.00-1.00   sec  22.9 MBytes   192 Mbits/sec    0    338 KBytes
[ 13]   0.00-1.00   sec  24.8 MBytes   208 Mbits/sec    0    322 KBytes
[ 15]   0.00-1.00   sec  24.4 MBytes   205 Mbits/sec    0    346 KBytes
[ 17]   0.00-1.00   sec  24.3 MBytes   204 Mbits/sec    0    331 KBytes
[ 19]   0.00-1.00   sec  24.7 MBytes   207 Mbits/sec    0    344 KBytes
[ 21]   0.00-1.00   sec  25.0 MBytes   209 Mbits/sec    0    341 KBytes
[ 23]   0.00-1.00   sec  23.1 MBytes   194 Mbits/sec    0    324 KBytes
[SUM]   0.00-1.00   sec   243 MBytes  2.04 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  21.0 MBytes   176 Mbits/sec   86    236 KBytes
[  7]   1.00-2.00   sec  20.3 MBytes   170 Mbits/sec  120    195 KBytes
[  9]   1.00-2.00   sec  21.1 MBytes   177 Mbits/sec   89    239 KBytes
[ 11]   1.00-2.00   sec  21.2 MBytes   178 Mbits/sec   75    235 KBytes
[ 13]   1.00-2.00   sec  20.1 MBytes   169 Mbits/sec   99    228 KBytes
[ 15]   1.00-2.00   sec  20.5 MBytes   172 Mbits/sec   94    147 KBytes
[ 17]   1.00-2.00   sec  20.9 MBytes   176 Mbits/sec  134    170 KBytes
[ 19]   1.00-2.00   sec  21.4 MBytes   179 Mbits/sec   91    236 KBytes
[ 21]   1.00-2.00   sec  21.5 MBytes   180 Mbits/sec   90    212 KBytes
[ 23]   1.00-2.00   sec  20.1 MBytes   169 Mbits/sec  142    194 KBytes
[SUM]   1.00-2.00   sec   208 MBytes  1.75 Gbits/sec  1020
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  24.2 MBytes   203 Mbits/sec    0    266 KBytes
[  7]   2.00-3.00   sec  24.2 MBytes   203 Mbits/sec    0    257 KBytes
[  9]   2.00-3.00   sec  24.5 MBytes   206 Mbits/sec    0    267 KBytes
[ 11]   2.00-3.00   sec  24.4 MBytes   205 Mbits/sec    0    267 KBytes
[ 13]   2.00-3.00   sec  24.1 MBytes   202 Mbits/sec    0    264 KBytes
[ 15]   2.00-3.00   sec  23.6 MBytes   198 Mbits/sec    0    240 KBytes
[ 17]   2.00-3.00   sec  23.9 MBytes   200 Mbits/sec    0    255 KBytes
[ 19]   2.00-3.00   sec  24.3 MBytes   204 Mbits/sec    0    266 KBytes
[ 21]   2.00-3.00   sec  24.4 MBytes   205 Mbits/sec    0    264 KBytes
[ 23]   2.00-3.00   sec  24.1 MBytes   202 Mbits/sec    0    260 KBytes
[SUM]   2.00-3.00   sec   242 MBytes  2.03 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  41.1 MBytes   344 Mbits/sec    0    313 KBytes
[  7]   3.00-4.00   sec  41.1 MBytes   345 Mbits/sec    0    305 KBytes
[  9]   3.00-4.00   sec  41.2 MBytes   346 Mbits/sec    0    315 KBytes
[ 11]   3.00-4.00   sec  41.1 MBytes   345 Mbits/sec    0    313 KBytes
[ 13]   3.00-4.00   sec  40.5 MBytes   340 Mbits/sec    0    313 KBytes
[ 15]   3.00-4.00   sec  41.1 MBytes   345 Mbits/sec    0    293 KBytes
[ 17]   3.00-4.00   sec  41.0 MBytes   344 Mbits/sec    0    301 KBytes
[ 19]   3.00-4.00   sec  41.2 MBytes   346 Mbits/sec    0    311 KBytes
[ 21]   3.00-4.00   sec  41.0 MBytes   344 Mbits/sec    0    317 KBytes
[ 23]   3.00-4.00   sec  40.5 MBytes   340 Mbits/sec    0    305 KBytes
[SUM]   3.00-4.00   sec   410 MBytes  3.44 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  42.0 MBytes   352 Mbits/sec    0    334 KBytes
[  7]   4.00-5.00   sec  41.6 MBytes   349 Mbits/sec    0    334 KBytes
[  9]   4.00-5.00   sec  42.0 MBytes   352 Mbits/sec    0    334 KBytes
[ 11]   4.00-5.00   sec  41.6 MBytes   349 Mbits/sec    0    332 KBytes
[ 13]   4.00-5.00   sec  42.4 MBytes   356 Mbits/sec    0    337 KBytes
[ 15]   4.00-5.00   sec  41.7 MBytes   350 Mbits/sec    0    331 KBytes
[ 17]   4.00-5.00   sec  41.7 MBytes   350 Mbits/sec    0    335 KBytes
[ 19]   4.00-5.00   sec  42.3 MBytes   355 Mbits/sec    0    334 KBytes
[ 21]   4.00-5.00   sec  42.5 MBytes   357 Mbits/sec    0    335 KBytes
[ 23]   4.00-5.00   sec  42.0 MBytes   352 Mbits/sec    0    329 KBytes
[SUM]   4.00-5.00   sec   420 MBytes  3.52 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   154 MBytes   258 Mbits/sec   86             sender
[  5]   0.00-5.01   sec   152 MBytes   255 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   152 MBytes   255 Mbits/sec  120             sender
[  7]   0.00-5.01   sec   151 MBytes   253 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   152 MBytes   256 Mbits/sec   89             sender
[  9]   0.00-5.01   sec   151 MBytes   252 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   151 MBytes   254 Mbits/sec   75             sender
[ 11]   0.00-5.01   sec   150 MBytes   251 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   152 MBytes   255 Mbits/sec   99             sender
[ 13]   0.00-5.01   sec   150 MBytes   252 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   151 MBytes   254 Mbits/sec   94             sender
[ 15]   0.00-5.01   sec   150 MBytes   251 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   152 MBytes   255 Mbits/sec  134             sender
[ 17]   0.00-5.01   sec   150 MBytes   252 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   154 MBytes   258 Mbits/sec   91             sender
[ 19]   0.00-5.01   sec   152 MBytes   255 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   154 MBytes   259 Mbits/sec   90             sender
[ 21]   0.00-5.01   sec   152 MBytes   255 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   150 MBytes   251 Mbits/sec  142             sender
[ 23]   0.00-5.01   sec   148 MBytes   248 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.49 GBytes  2.55 Gbits/sec  1020             sender
[SUM]   0.00-5.01   sec  1.47 GBytes  2.52 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        221103  14593487          0     1093974  1656192473          0
eth1  up             0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.230 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 37144 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 37154 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 37162 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 37176 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 37186 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 37194 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 37210 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 37220 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 37222 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 37226 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  47.2 MBytes   396 Mbits/sec    0    573 KBytes
[  7]   0.00-1.00   sec  34.3 MBytes   288 Mbits/sec    0    395 KBytes
[  9]   0.00-1.00   sec  34.8 MBytes   292 Mbits/sec    0    530 KBytes
[ 11]   0.00-1.00   sec  76.2 MBytes   640 Mbits/sec    0   1015 KBytes
[ 13]   0.00-1.00   sec  36.1 MBytes   303 Mbits/sec    0    658 KBytes
[ 15]   0.00-1.00   sec  33.9 MBytes   285 Mbits/sec    0    403 KBytes
[ 17]   0.00-1.00   sec  34.4 MBytes   289 Mbits/sec    0    385 KBytes
[ 19]   0.00-1.00   sec  45.4 MBytes   381 Mbits/sec    0    573 KBytes
[ 21]   0.00-1.00   sec  34.2 MBytes   287 Mbits/sec    0    378 KBytes
[ 23]   0.00-1.00   sec  34.0 MBytes   285 Mbits/sec    0    409 KBytes
[SUM]   0.00-1.00   sec   411 MBytes  3.44 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  50.5 MBytes   423 Mbits/sec   39    464 KBytes
[  7]   1.00-2.00   sec  33.4 MBytes   280 Mbits/sec   45    327 KBytes
[  9]   1.00-2.00   sec  34.0 MBytes   285 Mbits/sec   71    386 KBytes
[ 11]   1.00-2.00   sec  67.5 MBytes   566 Mbits/sec   64    711 KBytes
[ 13]   1.00-2.00   sec  33.8 MBytes   283 Mbits/sec   45    460 KBytes
[ 15]   1.00-2.00   sec  33.8 MBytes   284 Mbits/sec   60    335 KBytes
[ 17]   1.00-2.00   sec  33.2 MBytes   279 Mbits/sec   52    317 KBytes
[ 19]   1.00-2.00   sec  52.6 MBytes   441 Mbits/sec  135    478 KBytes
[ 21]   1.00-2.00   sec  33.4 MBytes   280 Mbits/sec   45    315 KBytes
[ 23]   1.00-2.00   sec  33.6 MBytes   282 Mbits/sec   45    322 KBytes
[SUM]   1.00-2.00   sec   406 MBytes  3.40 Gbits/sec  601
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  55.4 MBytes   465 Mbits/sec   43    385 KBytes
[  7]   2.00-3.00   sec  35.9 MBytes   301 Mbits/sec   19    300 KBytes
[  9]   2.00-3.00   sec  36.0 MBytes   302 Mbits/sec   12    321 KBytes
[ 11]   2.00-3.00   sec  68.8 MBytes   577 Mbits/sec   50    535 KBytes
[ 13]   2.00-3.00   sec  36.2 MBytes   304 Mbits/sec   48    284 KBytes
[ 15]   2.00-3.00   sec  36.8 MBytes   309 Mbits/sec   45    288 KBytes
[ 17]   2.00-3.00   sec  35.0 MBytes   293 Mbits/sec   17    243 KBytes
[ 19]   2.00-3.00   sec  55.6 MBytes   467 Mbits/sec    8    385 KBytes
[ 21]   2.00-3.00   sec  36.6 MBytes   307 Mbits/sec    0    344 KBytes
[ 23]   2.00-3.00   sec  36.5 MBytes   307 Mbits/sec    0    369 KBytes
[SUM]   2.00-3.00   sec   433 MBytes  3.63 Gbits/sec  242
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  55.7 MBytes   468 Mbits/sec    0    424 KBytes
[  7]   3.00-4.00   sec  33.4 MBytes   280 Mbits/sec    0    321 KBytes
[  9]   3.00-4.00   sec  34.0 MBytes   285 Mbits/sec    0    345 KBytes
[ 11]   3.00-4.00   sec  68.8 MBytes   577 Mbits/sec    0    570 KBytes
[ 13]   3.00-4.00   sec  32.5 MBytes   273 Mbits/sec    0    317 KBytes
[ 15]   3.00-4.00   sec  32.9 MBytes   276 Mbits/sec    0    318 KBytes
[ 17]   3.00-4.00   sec  33.4 MBytes   280 Mbits/sec    0    305 KBytes
[ 19]   3.00-4.00   sec  49.6 MBytes   416 Mbits/sec    9    349 KBytes
[ 21]   3.00-4.00   sec  34.1 MBytes   286 Mbits/sec    0    369 KBytes
[ 23]   3.00-4.00   sec  33.5 MBytes   281 Mbits/sec    0    385 KBytes
[SUM]   3.00-4.00   sec   408 MBytes  3.42 Gbits/sec    9
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  59.2 MBytes   496 Mbits/sec  135    372 KBytes
[  7]   4.00-5.00   sec  35.0 MBytes   293 Mbits/sec  135    300 KBytes
[  9]   4.00-5.00   sec  35.2 MBytes   296 Mbits/sec   90    308 KBytes
[ 11]   4.00-5.00   sec  68.8 MBytes   577 Mbits/sec  135    444 KBytes
[ 13]   4.00-5.00   sec  35.0 MBytes   294 Mbits/sec   90    294 KBytes
[ 15]   4.00-5.00   sec  34.4 MBytes   288 Mbits/sec  135    297 KBytes
[ 17]   4.00-5.00   sec  34.3 MBytes   288 Mbits/sec   89    293 KBytes
[ 19]   4.00-5.00   sec  56.6 MBytes   475 Mbits/sec   98    337 KBytes
[ 21]   4.00-5.00   sec  34.3 MBytes   288 Mbits/sec  135    314 KBytes
[ 23]   4.00-5.00   sec  35.2 MBytes   295 Mbits/sec  135    315 KBytes
[SUM]   4.00-5.00   sec   428 MBytes  3.59 Gbits/sec  1177
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   268 MBytes   449 Mbits/sec  217             sender
[  5]   0.00-5.01   sec   266 MBytes   445 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   172 MBytes   288 Mbits/sec  199             sender
[  7]   0.00-5.01   sec   170 MBytes   284 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   174 MBytes   292 Mbits/sec  173             sender
[  9]   0.00-5.01   sec   171 MBytes   287 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   350 MBytes   587 Mbits/sec  249             sender
[ 11]   0.00-5.01   sec   346 MBytes   580 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   174 MBytes   291 Mbits/sec  183             sender
[ 13]   0.00-5.01   sec   170 MBytes   285 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   172 MBytes   288 Mbits/sec  240             sender
[ 15]   0.00-5.01   sec   170 MBytes   285 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   170 MBytes   286 Mbits/sec  158             sender
[ 17]   0.00-5.01   sec   168 MBytes   282 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   260 MBytes   436 Mbits/sec  250             sender
[ 19]   0.00-5.01   sec   258 MBytes   432 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   173 MBytes   290 Mbits/sec  180             sender
[ 21]   0.00-5.01   sec   171 MBytes   286 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   173 MBytes   290 Mbits/sec  180             sender
[ 23]   0.00-5.01   sec   171 MBytes   287 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  2.04 GBytes  3.50 Gbits/sec  2029             sender
[SUM]   0.00-5.01   sec  2.01 GBytes  3.45 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        209878  13854830          0      865658  1310509511          0
eth1  up        185687  12258882          0      631542   956067621          0

Note

As you can see, this time traffic is going out through both bonded interfaces.