Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=464 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 463.741/463.741/463.741/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 58260 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 58266 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 58274 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 58290 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 58302 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 58304 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 58318 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 58330 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 58342 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 58352 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  46.7 MBytes   392 Mbits/sec  144    189 KBytes
[  7]   0.00-1.00   sec  51.0 MBytes   427 Mbits/sec  163    202 KBytes
[  9]   0.00-1.00   sec  41.2 MBytes   346 Mbits/sec   83    165 KBytes
[ 11]   0.00-1.00   sec  42.7 MBytes   358 Mbits/sec   38    228 KBytes
[ 13]   0.00-1.00   sec  45.4 MBytes   381 Mbits/sec   66    214 KBytes
[ 15]   0.00-1.00   sec  46.6 MBytes   391 Mbits/sec  103    214 KBytes
[ 17]   0.00-1.00   sec  35.6 MBytes   298 Mbits/sec   82    164 KBytes
[ 19]   0.00-1.00   sec  44.5 MBytes   373 Mbits/sec   95    215 KBytes
[ 21]   0.00-1.00   sec  43.8 MBytes   368 Mbits/sec  107    212 KBytes
[ 23]   0.00-1.00   sec  42.4 MBytes   355 Mbits/sec  146    201 KBytes
[SUM]   0.00-1.00   sec   440 MBytes  3.69 Gbits/sec  1027
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  48.5 MBytes   407 Mbits/sec    0    284 KBytes
[  7]   1.00-2.00   sec  48.3 MBytes   405 Mbits/sec    0    277 KBytes
[  9]   1.00-2.00   sec  47.5 MBytes   399 Mbits/sec    0    272 KBytes
[ 11]   1.00-2.00   sec  47.2 MBytes   396 Mbits/sec   26    272 KBytes
[ 13]   1.00-2.00   sec  47.5 MBytes   398 Mbits/sec   53    266 KBytes
[ 15]   1.00-2.00   sec  47.2 MBytes   396 Mbits/sec    0    284 KBytes
[ 17]   1.00-2.00   sec  45.2 MBytes   380 Mbits/sec    0    240 KBytes
[ 19]   1.00-2.00   sec  44.4 MBytes   372 Mbits/sec   39    238 KBytes
[ 21]   1.00-2.00   sec  47.3 MBytes   397 Mbits/sec   26    260 KBytes
[ 23]   1.00-2.00   sec  46.1 MBytes   387 Mbits/sec    0    264 KBytes
[SUM]   1.00-2.00   sec   469 MBytes  3.94 Gbits/sec  144
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  47.0 MBytes   395 Mbits/sec    0    317 KBytes
[  7]   2.00-3.00   sec  46.7 MBytes   391 Mbits/sec    0    315 KBytes
[  9]   2.00-3.00   sec  46.9 MBytes   393 Mbits/sec    0    313 KBytes
[ 11]   2.00-3.00   sec  47.6 MBytes   399 Mbits/sec    0    308 KBytes
[ 13]   2.00-3.00   sec  47.1 MBytes   395 Mbits/sec    0    303 KBytes
[ 15]   2.00-3.00   sec  47.2 MBytes   396 Mbits/sec    0    313 KBytes
[ 17]   2.00-3.00   sec  47.7 MBytes   400 Mbits/sec    0    286 KBytes
[ 19]   2.00-3.00   sec  47.1 MBytes   395 Mbits/sec    0    291 KBytes
[ 21]   2.00-3.00   sec  46.9 MBytes   394 Mbits/sec    0    311 KBytes
[ 23]   2.00-3.00   sec  46.8 MBytes   392 Mbits/sec    0    298 KBytes
[SUM]   2.00-3.00   sec   471 MBytes  3.95 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  43.9 MBytes   368 Mbits/sec   38    267 KBytes
[  7]   3.00-4.00   sec  40.3 MBytes   338 Mbits/sec   93    158 KBytes
[  9]   3.00-4.00   sec  39.5 MBytes   331 Mbits/sec  133    160 KBytes
[ 11]   3.00-4.00   sec  40.8 MBytes   342 Mbits/sec  145    206 KBytes
[ 13]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec   85    133 KBytes
[ 15]   3.00-4.00   sec  43.2 MBytes   362 Mbits/sec   62    264 KBytes
[ 17]   3.00-4.00   sec  39.6 MBytes   332 Mbits/sec  141    158 KBytes
[ 19]   3.00-4.00   sec  40.4 MBytes   339 Mbits/sec  100    205 KBytes
[ 21]   3.00-4.00   sec  41.5 MBytes   348 Mbits/sec  114    198 KBytes
[ 23]   3.00-4.00   sec  39.3 MBytes   330 Mbits/sec  163    158 KBytes
[SUM]   3.00-4.00   sec   406 MBytes  3.41 Gbits/sec  1074
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  44.5 MBytes   373 Mbits/sec    0    337 KBytes
[  7]   4.00-5.00   sec  40.2 MBytes   337 Mbits/sec   21    204 KBytes
[  9]   4.00-5.00   sec  37.5 MBytes   314 Mbits/sec   42    180 KBytes
[ 11]   4.00-5.00   sec  39.5 MBytes   331 Mbits/sec   11    259 KBytes
[ 13]   4.00-5.00   sec  32.6 MBytes   273 Mbits/sec   80    163 KBytes
[ 15]   4.00-5.00   sec  44.9 MBytes   376 Mbits/sec   21    245 KBytes
[ 17]   4.00-5.00   sec  37.0 MBytes   311 Mbits/sec   72    187 KBytes
[ 19]   4.00-5.00   sec  40.3 MBytes   338 Mbits/sec    5    255 KBytes
[ 21]   4.00-5.00   sec  39.1 MBytes   328 Mbits/sec   88    198 KBytes
[ 23]   4.00-5.00   sec  37.7 MBytes   316 Mbits/sec   33    242 KBytes
[SUM]   4.00-5.00   sec   393 MBytes  3.30 Gbits/sec  373
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   231 MBytes   387 Mbits/sec  182             sender
[  5]   0.00-5.01   sec   229 MBytes   384 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   226 MBytes   380 Mbits/sec  277             sender
[  7]   0.00-5.01   sec   225 MBytes   376 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   213 MBytes   357 Mbits/sec  258             sender
[  9]   0.00-5.01   sec   211 MBytes   354 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   218 MBytes   365 Mbits/sec  220             sender
[ 11]   0.00-5.01   sec   217 MBytes   363 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   210 MBytes   353 Mbits/sec  284             sender
[ 13]   0.00-5.01   sec   209 MBytes   350 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   229 MBytes   384 Mbits/sec  186             sender
[ 15]   0.00-5.01   sec   227 MBytes   380 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   205 MBytes   344 Mbits/sec  295             sender
[ 17]   0.00-5.01   sec   204 MBytes   342 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   217 MBytes   363 Mbits/sec  239             sender
[ 19]   0.00-5.01   sec   215 MBytes   360 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   219 MBytes   367 Mbits/sec  335             sender
[ 21]   0.00-5.01   sec   217 MBytes   363 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   212 MBytes   356 Mbits/sec  342             sender
[ 23]   0.00-5.01   sec   210 MBytes   353 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  2.13 GBytes  3.66 Gbits/sec  2618             sender
[SUM]   0.00-5.01   sec  2.11 GBytes  3.62 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        159595  10566072          0     1572494  2378316395          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.235 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 52994 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 53000 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 53014 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 53020 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 53030 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 53032 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 53044 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 53054 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 53066 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 53080 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  34.7 MBytes   291 Mbits/sec  131    173 KBytes
[  7]   0.00-1.00   sec  45.2 MBytes   379 Mbits/sec  111    197 KBytes
[  9]   0.00-1.00   sec  35.3 MBytes   296 Mbits/sec   85    185 KBytes
[ 11]   0.00-1.00   sec  54.2 MBytes   455 Mbits/sec  209    267 KBytes
[ 13]   0.00-1.00   sec  33.7 MBytes   283 Mbits/sec   73    180 KBytes
[ 15]   0.00-1.00   sec  47.9 MBytes   401 Mbits/sec   49    267 KBytes
[ 17]   0.00-1.00   sec  68.5 MBytes   575 Mbits/sec  151    334 KBytes
[ 19]   0.00-1.00   sec  37.9 MBytes   318 Mbits/sec   63    174 KBytes
[ 21]   0.00-1.00   sec  39.5 MBytes   331 Mbits/sec   94    178 KBytes
[ 23]   0.00-1.00   sec  55.2 MBytes   463 Mbits/sec  181    280 KBytes
[SUM]   0.00-1.00   sec   452 MBytes  3.79 Gbits/sec  1147
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  32.9 MBytes   276 Mbits/sec   48    201 KBytes
[  7]   1.00-2.00   sec  41.1 MBytes   344 Mbits/sec   25    233 KBytes
[  9]   1.00-2.00   sec  40.8 MBytes   342 Mbits/sec   26    215 KBytes
[ 11]   1.00-2.00   sec  47.9 MBytes   402 Mbits/sec   43    264 KBytes
[ 13]   1.00-2.00   sec  39.0 MBytes   327 Mbits/sec  124    219 KBytes
[ 15]   1.00-2.00   sec  42.9 MBytes   360 Mbits/sec   15    267 KBytes
[ 17]   1.00-2.00   sec  51.2 MBytes   430 Mbits/sec   16    280 KBytes
[ 19]   1.00-2.00   sec  31.9 MBytes   267 Mbits/sec   27    197 KBytes
[ 21]   1.00-2.00   sec  38.5 MBytes   323 Mbits/sec   61    219 KBytes
[ 23]   1.00-2.00   sec  47.0 MBytes   394 Mbits/sec  134    264 KBytes
[SUM]   1.00-2.00   sec   413 MBytes  3.47 Gbits/sec  519
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  54.8 MBytes   460 Mbits/sec    5    232 KBytes
[  7]   2.00-3.00   sec  54.4 MBytes   457 Mbits/sec   20    225 KBytes
[  9]   2.00-3.00   sec  40.9 MBytes   343 Mbits/sec   30   1.41 KBytes
[ 11]   2.00-3.00   sec  37.6 MBytes   316 Mbits/sec   55    226 KBytes
[ 13]   2.00-3.00   sec  49.0 MBytes   411 Mbits/sec   37    247 KBytes
[ 15]   2.00-3.00   sec  48.8 MBytes   410 Mbits/sec   29    233 KBytes
[ 17]   2.00-3.00   sec  38.8 MBytes   325 Mbits/sec   10    223 KBytes
[ 19]   2.00-3.00   sec  39.8 MBytes   334 Mbits/sec   27    245 KBytes
[ 21]   2.00-3.00   sec  48.0 MBytes   403 Mbits/sec   34    228 KBytes
[ 23]   2.00-3.00   sec  38.4 MBytes   322 Mbits/sec   26    226 KBytes
[SUM]   2.00-3.00   sec   451 MBytes  3.78 Gbits/sec  273
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  36.0 MBytes   302 Mbits/sec  101    178 KBytes
[  7]   3.00-4.00   sec  39.7 MBytes   333 Mbits/sec  157    161 KBytes
[  9]   3.00-4.00   sec  21.7 MBytes   182 Mbits/sec   61    198 KBytes
[ 11]   3.00-4.00   sec  34.6 MBytes   290 Mbits/sec   94    226 KBytes
[ 13]   3.00-4.00   sec  41.1 MBytes   345 Mbits/sec   69    216 KBytes
[ 15]   3.00-4.00   sec  34.2 MBytes   287 Mbits/sec   37    153 KBytes
[ 17]   3.00-4.00   sec  37.5 MBytes   315 Mbits/sec   47    252 KBytes
[ 19]   3.00-4.00   sec  48.4 MBytes   406 Mbits/sec  135    332 KBytes
[ 21]   3.00-4.00   sec  44.2 MBytes   371 Mbits/sec   83    281 KBytes
[ 23]   3.00-4.00   sec  38.6 MBytes   324 Mbits/sec  455    189 KBytes
[SUM]   3.00-4.00   sec   376 MBytes  3.15 Gbits/sec  1239
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  40.3 MBytes   337 Mbits/sec   69    147 KBytes
[  7]   4.00-5.00   sec  44.7 MBytes   374 Mbits/sec   32    236 KBytes
[  9]   4.00-5.00   sec  40.8 MBytes   342 Mbits/sec   45    239 KBytes
[ 11]   4.00-5.00   sec  39.3 MBytes   329 Mbits/sec   58    134 KBytes
[ 13]   4.00-5.00   sec  46.7 MBytes   391 Mbits/sec   40    204 KBytes
[ 15]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec   39    123 KBytes
[ 17]   4.00-5.00   sec  47.5 MBytes   398 Mbits/sec   38    133 KBytes
[ 19]   4.00-5.00   sec  46.6 MBytes   390 Mbits/sec  104    281 KBytes
[ 21]   4.00-5.00   sec  49.2 MBytes   412 Mbits/sec   49    232 KBytes
[ 23]   4.00-5.00   sec  41.2 MBytes   345 Mbits/sec   17    146 KBytes
[SUM]   4.00-5.00   sec   434 MBytes  3.63 Gbits/sec  491
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   199 MBytes   333 Mbits/sec  354             sender
[  5]   0.00-5.00   sec   197 MBytes   331 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   225 MBytes   378 Mbits/sec  345             sender
[  7]   0.00-5.00   sec   223 MBytes   374 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   179 MBytes   301 Mbits/sec  247             sender
[  9]   0.00-5.00   sec   178 MBytes   298 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   214 MBytes   358 Mbits/sec  459             sender
[ 11]   0.00-5.00   sec   211 MBytes   354 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   210 MBytes   351 Mbits/sec  343             sender
[ 13]   0.00-5.00   sec   208 MBytes   349 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   211 MBytes   354 Mbits/sec  169             sender
[ 15]   0.00-5.00   sec   210 MBytes   352 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   244 MBytes   408 Mbits/sec  262             sender
[ 17]   0.00-5.00   sec   240 MBytes   402 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   205 MBytes   343 Mbits/sec  356             sender
[ 19]   0.00-5.00   sec   201 MBytes   338 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   220 MBytes   368 Mbits/sec  321             sender
[ 21]   0.00-5.00   sec   218 MBytes   365 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   220 MBytes   370 Mbits/sec  813             sender
[ 23]   0.00-5.00   sec   218 MBytes   365 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  2.08 GBytes  3.56 Gbits/sec  3669             sender
[SUM]   0.00-5.00   sec  2.05 GBytes  3.53 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        141371   9367580          0      800941  1212134168          0
eth1  up        125974   8343056          0      730008  1104634569          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.