Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=453 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 453.243/453.243/453.243/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 50176 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 50188 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 50200 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 50216 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 50220 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 50236 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 50244 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 50258 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 50264 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 50268 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  45.3 MBytes   380 Mbits/sec  133    277 KBytes
[  7]   0.00-1.00   sec  42.0 MBytes   352 Mbits/sec  132    199 KBytes
[  9]   0.00-1.00   sec  42.1 MBytes   353 Mbits/sec   92    199 KBytes
[ 11]   0.00-1.00   sec  43.1 MBytes   362 Mbits/sec  101    206 KBytes
[ 13]   0.00-1.00   sec  42.3 MBytes   355 Mbits/sec   86    201 KBytes
[ 15]   0.00-1.00   sec  42.4 MBytes   356 Mbits/sec   72    197 KBytes
[ 17]   0.00-1.00   sec  41.8 MBytes   351 Mbits/sec   97    194 KBytes
[ 19]   0.00-1.00   sec  41.4 MBytes   347 Mbits/sec  118    194 KBytes
[ 21]   0.00-1.00   sec  41.1 MBytes   345 Mbits/sec   99    195 KBytes
[ 23]   0.00-1.00   sec  41.9 MBytes   351 Mbits/sec  142    199 KBytes
[SUM]   0.00-1.00   sec   423 MBytes  3.55 Gbits/sec  1072
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  34.2 MBytes   287 Mbits/sec  136    195 KBytes
[  7]   1.00-2.00   sec  32.7 MBytes   274 Mbits/sec   35    182 KBytes
[  9]   1.00-2.00   sec  32.1 MBytes   269 Mbits/sec   90    180 KBytes
[ 11]   1.00-2.00   sec  34.3 MBytes   288 Mbits/sec   52    198 KBytes
[ 13]   1.00-2.00   sec  35.4 MBytes   297 Mbits/sec   13    236 KBytes
[ 15]   1.00-2.00   sec  34.0 MBytes   285 Mbits/sec   46    198 KBytes
[ 17]   1.00-2.00   sec  33.7 MBytes   283 Mbits/sec   85    205 KBytes
[ 19]   1.00-2.00   sec  33.5 MBytes   281 Mbits/sec   64    206 KBytes
[ 21]   1.00-2.00   sec  33.9 MBytes   284 Mbits/sec   21    209 KBytes
[ 23]   1.00-2.00   sec  35.3 MBytes   296 Mbits/sec   50    233 KBytes
[SUM]   1.00-2.00   sec   339 MBytes  2.84 Gbits/sec  592
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  37.0 MBytes   311 Mbits/sec   19    160 KBytes
[  7]   2.00-3.00   sec  36.8 MBytes   309 Mbits/sec  102    157 KBytes
[  9]   2.00-3.00   sec  38.4 MBytes   322 Mbits/sec   43    171 KBytes
[ 11]   2.00-3.00   sec  38.7 MBytes   324 Mbits/sec   70    181 KBytes
[ 13]   2.00-3.00   sec  40.3 MBytes   338 Mbits/sec   36    262 KBytes
[ 15]   2.00-3.00   sec  39.8 MBytes   334 Mbits/sec   45    246 KBytes
[ 17]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec   84    178 KBytes
[ 19]   2.00-3.00   sec  39.6 MBytes   333 Mbits/sec   45    252 KBytes
[ 21]   2.00-3.00   sec  34.0 MBytes   285 Mbits/sec  117    134 KBytes
[ 23]   2.00-3.00   sec  37.7 MBytes   316 Mbits/sec   67    157 KBytes
[SUM]   2.00-3.00   sec   380 MBytes  3.19 Gbits/sec  628
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  44.6 MBytes   374 Mbits/sec   45    199 KBytes
[  7]   3.00-4.00   sec  42.0 MBytes   352 Mbits/sec   51    221 KBytes
[  9]   3.00-4.00   sec  44.9 MBytes   376 Mbits/sec   45    205 KBytes
[ 11]   3.00-4.00   sec  43.8 MBytes   368 Mbits/sec   70    182 KBytes
[ 13]   3.00-4.00   sec  46.9 MBytes   393 Mbits/sec   91    201 KBytes
[ 15]   3.00-4.00   sec  44.9 MBytes   376 Mbits/sec   90    189 KBytes
[ 17]   3.00-4.00   sec  45.2 MBytes   379 Mbits/sec   50    208 KBytes
[ 19]   3.00-4.00   sec  45.6 MBytes   383 Mbits/sec   51    195 KBytes
[ 21]   3.00-4.00   sec  41.8 MBytes   350 Mbits/sec   53    173 KBytes
[ 23]   3.00-4.00   sec  42.7 MBytes   358 Mbits/sec   72    171 KBytes
[SUM]   3.00-4.00   sec   442 MBytes  3.71 Gbits/sec  618
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  42.3 MBytes   354 Mbits/sec   68    156 KBytes
[  7]   4.00-5.00   sec  43.3 MBytes   363 Mbits/sec   60    178 KBytes
[  9]   4.00-5.00   sec  42.9 MBytes   360 Mbits/sec   20    226 KBytes
[ 11]   4.00-5.00   sec  42.0 MBytes   352 Mbits/sec   76    151 KBytes
[ 13]   4.00-5.00   sec  41.9 MBytes   351 Mbits/sec   49    157 KBytes
[ 15]   4.00-5.00   sec  41.8 MBytes   351 Mbits/sec   50    218 KBytes
[ 17]   4.00-5.00   sec  45.9 MBytes   385 Mbits/sec   52    202 KBytes
[ 19]   4.00-5.00   sec  42.4 MBytes   356 Mbits/sec  104    215 KBytes
[ 21]   4.00-5.00   sec  43.3 MBytes   363 Mbits/sec   51    174 KBytes
[ 23]   4.00-5.00   sec  46.6 MBytes   391 Mbits/sec   20    218 KBytes
[SUM]   4.00-5.00   sec   432 MBytes  3.63 Gbits/sec  550
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   203 MBytes   341 Mbits/sec  401             sender
[  5]   0.00-5.01   sec   202 MBytes   338 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   197 MBytes   330 Mbits/sec  380             sender
[  7]   0.00-5.01   sec   195 MBytes   327 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   200 MBytes   336 Mbits/sec  290             sender
[  9]   0.00-5.01   sec   199 MBytes   333 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   202 MBytes   339 Mbits/sec  369             sender
[ 11]   0.00-5.01   sec   200 MBytes   335 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   207 MBytes   347 Mbits/sec  275             sender
[ 13]   0.00-5.01   sec   205 MBytes   344 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   203 MBytes   340 Mbits/sec  303             sender
[ 15]   0.00-5.01   sec   201 MBytes   337 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   205 MBytes   343 Mbits/sec  368             sender
[ 17]   0.00-5.01   sec   203 MBytes   340 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   203 MBytes   340 Mbits/sec  382             sender
[ 19]   0.00-5.01   sec   201 MBytes   336 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   194 MBytes   326 Mbits/sec  341             sender
[ 21]   0.00-5.01   sec   193 MBytes   323 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   204 MBytes   343 Mbits/sec  351             sender
[ 23]   0.00-5.01   sec   202 MBytes   339 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.97 GBytes  3.38 Gbits/sec  3460             sender
[SUM]   0.00-5.01   sec  1.95 GBytes  3.35 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        335290  22161332          0     1453365  2200286506          0
eth1  up             0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.209 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 43342 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 43348 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 43352 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 43354 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 43362 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 43374 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 43384 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 43394 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 43398 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 43400 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  49.4 MBytes   414 Mbits/sec   29    249 KBytes
[  7]   0.00-1.00   sec  51.9 MBytes   435 Mbits/sec  132    211 KBytes
[  9]   0.00-1.00   sec  56.4 MBytes   473 Mbits/sec  124    259 KBytes
[ 11]   0.00-1.00   sec  50.3 MBytes   421 Mbits/sec   85    215 KBytes
[ 13]   0.00-1.00   sec  49.0 MBytes   411 Mbits/sec   84    209 KBytes
[ 15]   0.00-1.00   sec  50.3 MBytes   422 Mbits/sec   34    214 KBytes
[ 17]   0.00-1.00   sec  55.8 MBytes   468 Mbits/sec  157    266 KBytes
[ 19]   0.00-1.00   sec  48.9 MBytes   410 Mbits/sec  159    212 KBytes
[ 21]   0.00-1.00   sec  41.6 MBytes   349 Mbits/sec  104    156 KBytes
[ 23]   0.00-1.00   sec  49.9 MBytes   419 Mbits/sec   85    228 KBytes
[SUM]   0.00-1.00   sec   503 MBytes  4.22 Gbits/sec  993
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  44.0 MBytes   369 Mbits/sec   31    239 KBytes
[  7]   1.00-2.00   sec  47.7 MBytes   401 Mbits/sec   39    211 KBytes
[  9]   1.00-2.00   sec  45.0 MBytes   377 Mbits/sec   89    174 KBytes
[ 11]   1.00-2.00   sec  43.2 MBytes   362 Mbits/sec   78    214 KBytes
[ 13]   1.00-2.00   sec  36.2 MBytes   304 Mbits/sec   24    177 KBytes
[ 15]   1.00-2.00   sec  47.4 MBytes   397 Mbits/sec   63    211 KBytes
[ 17]   1.00-2.00   sec  55.0 MBytes   461 Mbits/sec   18    304 KBytes
[ 19]   1.00-2.00   sec  49.3 MBytes   413 Mbits/sec   21    276 KBytes
[ 21]   1.00-2.00   sec  37.6 MBytes   316 Mbits/sec   25    192 KBytes
[ 23]   1.00-2.00   sec  47.5 MBytes   399 Mbits/sec  116    218 KBytes
[SUM]   1.00-2.00   sec   453 MBytes  3.80 Gbits/sec  504
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  20.6 MBytes   173 Mbits/sec   56    188 KBytes
[  7]   2.00-3.00   sec  19.8 MBytes   166 Mbits/sec   62    178 KBytes
[  9]   2.00-3.00   sec  18.8 MBytes   157 Mbits/sec   43    168 KBytes
[ 11]   2.00-3.00   sec  25.9 MBytes   217 Mbits/sec   40    221 KBytes
[ 13]   2.00-3.00   sec  21.8 MBytes   183 Mbits/sec    8    202 KBytes
[ 15]   2.00-3.00   sec  24.2 MBytes   203 Mbits/sec    2    222 KBytes
[ 17]   2.00-3.00   sec  33.8 MBytes   283 Mbits/sec   38    304 KBytes
[ 19]   2.00-3.00   sec  23.0 MBytes   193 Mbits/sec   66    209 KBytes
[ 21]   2.00-3.00   sec  17.6 MBytes   148 Mbits/sec   13    167 KBytes
[ 23]   2.00-3.00   sec  25.8 MBytes   216 Mbits/sec   46    325 KBytes
[SUM]   2.00-3.00   sec   231 MBytes  1.94 Gbits/sec  374
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  36.8 MBytes   309 Mbits/sec   41    269 KBytes
[  7]   3.00-4.00   sec  34.4 MBytes   289 Mbits/sec   12    253 KBytes
[  9]   3.00-4.00   sec  33.8 MBytes   283 Mbits/sec    7    249 KBytes
[ 11]   3.00-4.00   sec  39.8 MBytes   334 Mbits/sec   45    284 KBytes
[ 13]   3.00-4.00   sec  38.8 MBytes   325 Mbits/sec    8    274 KBytes
[ 15]   3.00-4.00   sec  38.5 MBytes   323 Mbits/sec   22    284 KBytes
[ 17]   3.00-4.00   sec  50.0 MBytes   419 Mbits/sec    0    379 KBytes
[ 19]   3.00-4.00   sec  44.8 MBytes   376 Mbits/sec    0    318 KBytes
[ 21]   3.00-4.00   sec  34.2 MBytes   287 Mbits/sec   28    255 KBytes
[ 23]   3.00-4.00   sec  47.4 MBytes   397 Mbits/sec    2    342 KBytes
[SUM]   3.00-4.00   sec   399 MBytes  3.34 Gbits/sec  165
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  42.9 MBytes   360 Mbits/sec   79    185 KBytes
[  7]   4.00-5.00   sec  39.8 MBytes   334 Mbits/sec  136    168 KBytes
[  9]   4.00-5.00   sec  38.8 MBytes   325 Mbits/sec  150    163 KBytes
[ 11]   4.00-5.00   sec  47.4 MBytes   398 Mbits/sec   38    252 KBytes
[ 13]   4.00-5.00   sec  44.8 MBytes   376 Mbits/sec   97    184 KBytes
[ 15]   4.00-5.00   sec  40.5 MBytes   340 Mbits/sec   52    219 KBytes
[ 17]   4.00-5.00   sec  55.0 MBytes   461 Mbits/sec   19    263 KBytes
[ 19]   4.00-5.00   sec  54.4 MBytes   457 Mbits/sec  105    232 KBytes
[ 21]   4.00-5.00   sec  46.2 MBytes   387 Mbits/sec   51    233 KBytes
[ 23]   4.00-5.00   sec  46.0 MBytes   386 Mbits/sec   59    177 KBytes
[SUM]   4.00-5.00   sec   456 MBytes  3.82 Gbits/sec  786
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   194 MBytes   325 Mbits/sec  236             sender
[  5]   0.00-5.01   sec   191 MBytes   321 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   194 MBytes   325 Mbits/sec  381             sender
[  7]   0.00-5.01   sec   191 MBytes   321 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   193 MBytes   323 Mbits/sec  413             sender
[  9]   0.00-5.01   sec   189 MBytes   317 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   207 MBytes   347 Mbits/sec  286             sender
[ 11]   0.00-5.01   sec   205 MBytes   343 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   191 MBytes   320 Mbits/sec  221             sender
[ 13]   0.00-5.01   sec   188 MBytes   316 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   201 MBytes   337 Mbits/sec  173             sender
[ 15]   0.00-5.01   sec   199 MBytes   333 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   250 MBytes   419 Mbits/sec  232             sender
[ 17]   0.00-5.01   sec   247 MBytes   413 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   220 MBytes   370 Mbits/sec  351             sender
[ 19]   0.00-5.01   sec   218 MBytes   365 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   177 MBytes   297 Mbits/sec  221             sender
[ 21]   0.00-5.01   sec   176 MBytes   294 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   217 MBytes   363 Mbits/sec  308             sender
[ 23]   0.00-5.01   sec   214 MBytes   359 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.99 GBytes  3.43 Gbits/sec  2822             sender
[SUM]   0.00-5.01   sec  1.97 GBytes  3.38 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        197178  13026592          0      856049  1294389305          0
eth1  up        162949  10777261          0      612093   925416782          0

Note

As you can see, this time traffic is going out through both bonded interfaces.