Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=461 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 461.074/461.074/461.074/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 40662 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 40664 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 40678 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 40694 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 40698 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 40700 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 40710 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 40716 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 40726 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 40734 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  37.0 MBytes   310 Mbits/sec  198    226 KBytes
[  7]   0.00-1.00   sec  38.0 MBytes   319 Mbits/sec  180    232 KBytes
[  9]   0.00-1.00   sec  37.1 MBytes   311 Mbits/sec   67    229 KBytes
[ 11]   0.00-1.00   sec  35.4 MBytes   297 Mbits/sec  138    187 KBytes
[ 13]   0.00-1.00   sec  39.1 MBytes   328 Mbits/sec  128    242 KBytes
[ 15]   0.00-1.00   sec  35.6 MBytes   299 Mbits/sec  149    235 KBytes
[ 17]   0.00-1.00   sec  37.1 MBytes   311 Mbits/sec  103    226 KBytes
[ 19]   0.00-1.00   sec  37.3 MBytes   313 Mbits/sec  121    240 KBytes
[ 21]   0.00-1.00   sec  38.4 MBytes   322 Mbits/sec   73    279 KBytes
[ 23]   0.00-1.00   sec  36.7 MBytes   308 Mbits/sec  163    232 KBytes
[SUM]   0.00-1.00   sec   372 MBytes  3.12 Gbits/sec  1320
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  34.8 MBytes   292 Mbits/sec   49    208 KBytes
[  7]   1.00-2.00   sec  34.2 MBytes   287 Mbits/sec   72    164 KBytes
[  9]   1.00-2.00   sec  33.6 MBytes   282 Mbits/sec   90    164 KBytes
[ 11]   1.00-2.00   sec  34.8 MBytes   292 Mbits/sec   40    246 KBytes
[ 13]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec   63    208 KBytes
[ 15]   1.00-2.00   sec  33.8 MBytes   284 Mbits/sec  103    147 KBytes
[ 17]   1.00-2.00   sec  34.2 MBytes   287 Mbits/sec   51    206 KBytes
[ 19]   1.00-2.00   sec  34.1 MBytes   286 Mbits/sec   97    170 KBytes
[ 21]   1.00-2.00   sec  34.4 MBytes   288 Mbits/sec   98    156 KBytes
[ 23]   1.00-2.00   sec  34.7 MBytes   291 Mbits/sec  135    192 KBytes
[SUM]   1.00-2.00   sec   344 MBytes  2.88 Gbits/sec  798
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  39.6 MBytes   333 Mbits/sec   52    222 KBytes
[  7]   2.00-3.00   sec  35.8 MBytes   300 Mbits/sec   42    187 KBytes
[  9]   2.00-3.00   sec  37.8 MBytes   317 Mbits/sec   77    208 KBytes
[ 11]   2.00-3.00   sec  39.1 MBytes   328 Mbits/sec   58    205 KBytes
[ 13]   2.00-3.00   sec  36.7 MBytes   308 Mbits/sec   52    198 KBytes
[ 15]   2.00-3.00   sec  38.0 MBytes   318 Mbits/sec   39    204 KBytes
[ 17]   2.00-3.00   sec  37.2 MBytes   312 Mbits/sec   93    198 KBytes
[ 19]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec    2    209 KBytes
[ 21]   2.00-3.00   sec  36.2 MBytes   303 Mbits/sec   15    184 KBytes
[ 23]   2.00-3.00   sec  36.7 MBytes   308 Mbits/sec    9    192 KBytes
[SUM]   2.00-3.00   sec   375 MBytes  3.15 Gbits/sec  439
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  39.2 MBytes   329 Mbits/sec   44    279 KBytes
[  7]   3.00-4.00   sec  39.9 MBytes   335 Mbits/sec    0    293 KBytes
[  9]   3.00-4.00   sec  39.9 MBytes   335 Mbits/sec    0    298 KBytes
[ 11]   3.00-4.00   sec  39.8 MBytes   334 Mbits/sec    0    298 KBytes
[ 13]   3.00-4.00   sec  40.4 MBytes   339 Mbits/sec    0    297 KBytes
[ 15]   3.00-4.00   sec  38.7 MBytes   325 Mbits/sec    5    274 KBytes
[ 17]   3.00-4.00   sec  38.8 MBytes   325 Mbits/sec    5    269 KBytes
[ 19]   3.00-4.00   sec  39.0 MBytes   327 Mbits/sec   45    274 KBytes
[ 21]   3.00-4.00   sec  40.1 MBytes   336 Mbits/sec    0    294 KBytes
[ 23]   3.00-4.00   sec  38.6 MBytes   324 Mbits/sec   32    269 KBytes
[SUM]   3.00-4.00   sec   394 MBytes  3.31 Gbits/sec  131
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  38.0 MBytes   319 Mbits/sec   71    180 KBytes
[  7]   4.00-5.00   sec  38.5 MBytes   323 Mbits/sec  118    182 KBytes
[  9]   4.00-5.00   sec  41.0 MBytes   344 Mbits/sec   77    221 KBytes
[ 11]   4.00-5.00   sec  38.9 MBytes   326 Mbits/sec  103    187 KBytes
[ 13]   4.00-5.00   sec  38.1 MBytes   319 Mbits/sec   53    257 KBytes
[ 15]   4.00-5.00   sec  38.5 MBytes   323 Mbits/sec   58    180 KBytes
[ 17]   4.00-5.00   sec  39.1 MBytes   328 Mbits/sec   68    208 KBytes
[ 19]   4.00-5.00   sec  37.7 MBytes   316 Mbits/sec   96    181 KBytes
[ 21]   4.00-5.00   sec  39.1 MBytes   328 Mbits/sec   56    171 KBytes
[ 23]   4.00-5.00   sec  37.9 MBytes   318 Mbits/sec  161    178 KBytes
[SUM]   4.00-5.00   sec   387 MBytes  3.24 Gbits/sec  861
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   189 MBytes   317 Mbits/sec  414             sender
[  5]   0.00-5.00   sec   187 MBytes   313 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   186 MBytes   313 Mbits/sec  412             sender
[  7]   0.00-5.00   sec   184 MBytes   309 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   189 MBytes   318 Mbits/sec  311             sender
[  9]   0.00-5.00   sec   188 MBytes   314 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   188 MBytes   315 Mbits/sec  339             sender
[ 11]   0.00-5.00   sec   186 MBytes   312 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   189 MBytes   318 Mbits/sec  296             sender
[ 13]   0.00-5.00   sec   188 MBytes   315 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   185 MBytes   310 Mbits/sec  354             sender
[ 15]   0.00-5.00   sec   183 MBytes   306 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   186 MBytes   313 Mbits/sec  320             sender
[ 17]   0.00-5.00   sec   185 MBytes   310 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   186 MBytes   312 Mbits/sec  361             sender
[ 19]   0.00-5.00   sec   184 MBytes   309 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   188 MBytes   316 Mbits/sec  242             sender
[ 21]   0.00-5.00   sec   187 MBytes   313 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   185 MBytes   310 Mbits/sec  500             sender
[ 23]   0.00-5.00   sec   183 MBytes   307 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.83 GBytes  3.14 Gbits/sec  3549             sender
[SUM]   0.00-5.00   sec  1.81 GBytes  3.11 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        323448  21382873          0     1347675  2040297159          0
eth1  up             0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.228 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 44584 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 44586 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 44590 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 44594 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 44602 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 44612 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 44618 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 44620 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 44622 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 44628 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  74.2 MBytes   623 Mbits/sec    0    786 KBytes
[  7]   0.00-1.00   sec  34.8 MBytes   292 Mbits/sec   21    310 KBytes
[  9]   0.00-1.00   sec  34.7 MBytes   291 Mbits/sec    0    416 KBytes
[ 11]   0.00-1.00   sec  36.5 MBytes   306 Mbits/sec   37    407 KBytes
[ 13]   0.00-1.00   sec  30.5 MBytes   256 Mbits/sec   13    269 KBytes
[ 15]   0.00-1.00   sec  65.3 MBytes   548 Mbits/sec   49    448 KBytes
[ 17]   0.00-1.00   sec  35.0 MBytes   294 Mbits/sec    0    399 KBytes
[ 19]   0.00-1.00   sec  64.4 MBytes   540 Mbits/sec   57    461 KBytes
[ 21]   0.00-1.00   sec  27.4 MBytes   230 Mbits/sec   13    253 KBytes
[ 23]   0.00-1.00   sec  64.3 MBytes   540 Mbits/sec   18    420 KBytes
[SUM]   0.00-1.00   sec   467 MBytes  3.92 Gbits/sec  208
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  67.5 MBytes   566 Mbits/sec  273    219 KBytes
[  7]   1.00-2.00   sec  28.7 MBytes   241 Mbits/sec  102    124 KBytes
[  9]   1.00-2.00   sec  38.3 MBytes   321 Mbits/sec  121    178 KBytes
[ 11]   1.00-2.00   sec  39.1 MBytes   328 Mbits/sec  100    173 KBytes
[ 13]   1.00-2.00   sec  31.1 MBytes   261 Mbits/sec   96    204 KBytes
[ 15]   1.00-2.00   sec  65.3 MBytes   548 Mbits/sec  172    279 KBytes
[ 17]   1.00-2.00   sec  33.9 MBytes   284 Mbits/sec  120    189 KBytes
[ 19]   1.00-2.00   sec  53.9 MBytes   452 Mbits/sec  230    174 KBytes
[ 21]   1.00-2.00   sec  25.2 MBytes   212 Mbits/sec  211    109 KBytes
[ 23]   1.00-2.00   sec  72.3 MBytes   606 Mbits/sec  172    313 KBytes
[SUM]   1.00-2.00   sec   455 MBytes  3.82 Gbits/sec  1597
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  71.2 MBytes   598 Mbits/sec   33    253 KBytes
[  7]   2.00-3.00   sec  32.4 MBytes   272 Mbits/sec   13    195 KBytes
[  9]   2.00-3.00   sec  37.8 MBytes   317 Mbits/sec    3    230 KBytes
[ 11]   2.00-3.00   sec  34.2 MBytes   287 Mbits/sec   55    178 KBytes
[ 13]   2.00-3.00   sec  39.7 MBytes   333 Mbits/sec   14    240 KBytes
[ 15]   2.00-3.00   sec  61.3 MBytes   514 Mbits/sec  105    225 KBytes
[ 17]   2.00-3.00   sec  38.7 MBytes   325 Mbits/sec   23    238 KBytes
[ 19]   2.00-3.00   sec  44.5 MBytes   373 Mbits/sec   97    174 KBytes
[ 21]   2.00-3.00   sec  33.2 MBytes   279 Mbits/sec    0    249 KBytes
[ 23]   2.00-3.00   sec  73.1 MBytes   613 Mbits/sec   41    315 KBytes
[SUM]   2.00-3.00   sec   466 MBytes  3.91 Gbits/sec  384
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  65.0 MBytes   545 Mbits/sec   38    334 KBytes
[  7]   3.00-4.00   sec  36.6 MBytes   307 Mbits/sec   16    233 KBytes
[  9]   3.00-4.00   sec  32.4 MBytes   272 Mbits/sec   52    223 KBytes
[ 11]   3.00-4.00   sec  22.4 MBytes   188 Mbits/sec   65    124 KBytes
[ 13]   3.00-4.00   sec  28.7 MBytes   241 Mbits/sec   53    170 KBytes
[ 15]   3.00-4.00   sec  64.9 MBytes   544 Mbits/sec   10    315 KBytes
[ 17]   3.00-4.00   sec  25.8 MBytes   216 Mbits/sec   64    182 KBytes
[ 19]   3.00-4.00   sec  47.1 MBytes   395 Mbits/sec   55    260 KBytes
[ 21]   3.00-4.00   sec  38.6 MBytes   324 Mbits/sec   45    288 KBytes
[ 23]   3.00-4.00   sec  68.7 MBytes   576 Mbits/sec   74    297 KBytes
[SUM]   3.00-4.00   sec   430 MBytes  3.61 Gbits/sec  472
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  70.0 MBytes   587 Mbits/sec   78    191 KBytes
[  7]   4.00-5.00   sec  40.1 MBytes   337 Mbits/sec   18    269 KBytes
[  9]   4.00-5.00   sec  33.4 MBytes   280 Mbits/sec   78    156 KBytes
[ 11]   4.00-5.00   sec  26.1 MBytes   219 Mbits/sec   22    130 KBytes
[ 13]   4.00-5.00   sec  31.9 MBytes   268 Mbits/sec   63    170 KBytes
[ 15]   4.00-5.00   sec  60.3 MBytes   506 Mbits/sec  196    215 KBytes
[ 17]   4.00-5.00   sec  28.2 MBytes   236 Mbits/sec  114    139 KBytes
[ 19]   4.00-5.00   sec  62.5 MBytes   524 Mbits/sec   79    229 KBytes
[ 21]   4.00-5.00   sec  35.5 MBytes   298 Mbits/sec  140    170 KBytes
[ 23]   4.00-5.00   sec  66.2 MBytes   555 Mbits/sec  157    170 KBytes
[SUM]   4.00-5.00   sec   454 MBytes  3.81 Gbits/sec  945
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   348 MBytes   584 Mbits/sec  422             sender
[  5]   0.00-5.01   sec   345 MBytes   577 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   173 MBytes   290 Mbits/sec  170             sender
[  7]   0.00-5.01   sec   171 MBytes   287 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   177 MBytes   296 Mbits/sec  254             sender
[  9]   0.00-5.01   sec   175 MBytes   293 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   158 MBytes   265 Mbits/sec  279             sender
[ 11]   0.00-5.01   sec   156 MBytes   261 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   162 MBytes   272 Mbits/sec  239             sender
[ 13]   0.00-5.01   sec   161 MBytes   269 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   317 MBytes   532 Mbits/sec  532             sender
[ 15]   0.00-5.01   sec   314 MBytes   526 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   162 MBytes   271 Mbits/sec  321             sender
[ 17]   0.00-5.01   sec   160 MBytes   268 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   272 MBytes   457 Mbits/sec  518             sender
[ 19]   0.00-5.01   sec   270 MBytes   452 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   160 MBytes   268 Mbits/sec  409             sender
[ 21]   0.00-5.01   sec   159 MBytes   266 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   345 MBytes   578 Mbits/sec  462             sender
[ 23]   0.00-5.01   sec   342 MBytes   573 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  2.22 GBytes  3.81 Gbits/sec  3606             sender
[SUM]   0.00-5.01   sec  2.20 GBytes  3.77 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        224194  14813750          0      922472  1396542652          0
eth1  up        207126  13686898          0      712520  1078634986          0

Note

As you can see, this time traffic is going out through both bonded interfaces.