Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test Hash-Policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run the command interfaces bonding show on DUT0 and check whether the output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.90

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping the IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.527 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.527/0.527/0.527/0.000 ms

Step 6: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.90

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run the command interfaces ethernet clear on DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect the following output on DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 37974 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 37988 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 37992 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 37994 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 38000 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 38012 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 38024 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 38032 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 38038 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 38050 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  32.4 MBytes   272 Mbits/sec    4    216 KBytes
[  7]   0.00-1.00   sec  28.1 MBytes   235 Mbits/sec   53    106 KBytes
[  9]   0.00-1.00   sec  31.7 MBytes   266 Mbits/sec   80    182 KBytes
[ 11]   0.00-1.00   sec  27.5 MBytes   230 Mbits/sec   25    148 KBytes
[ 13]   0.00-1.00   sec  28.8 MBytes   241 Mbits/sec   64    198 KBytes
[ 15]   0.00-1.00   sec  27.2 MBytes   228 Mbits/sec  115    147 KBytes
[ 17]   0.00-1.00   sec  30.1 MBytes   252 Mbits/sec   18    189 KBytes
[ 19]   0.00-1.00   sec  37.7 MBytes   316 Mbits/sec   10    230 KBytes
[ 21]   0.00-1.00   sec  32.6 MBytes   273 Mbits/sec   24    247 KBytes
[ 23]   0.00-1.00   sec  32.1 MBytes   269 Mbits/sec   65    124 KBytes
[SUM]   0.00-1.00   sec   308 MBytes  2.58 Gbits/sec  458
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  23.1 MBytes   194 Mbits/sec    1    221 KBytes
[  7]   1.00-2.00   sec  20.9 MBytes   176 Mbits/sec    0    206 KBytes
[  9]   1.00-2.00   sec  21.1 MBytes   177 Mbits/sec   70    158 KBytes
[ 11]   1.00-2.00   sec  20.8 MBytes   174 Mbits/sec    9    195 KBytes
[ 13]   1.00-2.00   sec  22.3 MBytes   187 Mbits/sec    8    226 KBytes
[ 15]   1.00-2.00   sec  21.0 MBytes   176 Mbits/sec    1    197 KBytes
[ 17]   1.00-2.00   sec  21.4 MBytes   179 Mbits/sec   28    163 KBytes
[ 19]   1.00-2.00   sec  22.3 MBytes   187 Mbits/sec   76    174 KBytes
[ 21]   1.00-2.00   sec  20.8 MBytes   175 Mbits/sec   40    153 KBytes
[ 23]   1.00-2.00   sec  16.4 MBytes   138 Mbits/sec   27    124 KBytes
[SUM]   1.00-2.00   sec   210 MBytes  1.76 Gbits/sec  260
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  22.6 MBytes   189 Mbits/sec   55    188 KBytes
[  7]   2.00-3.00   sec  24.5 MBytes   205 Mbits/sec   32    199 KBytes
[  9]   2.00-3.00   sec  21.7 MBytes   182 Mbits/sec   71    150 KBytes
[ 11]   2.00-3.00   sec  24.0 MBytes   202 Mbits/sec    0    246 KBytes
[ 13]   2.00-3.00   sec  24.5 MBytes   206 Mbits/sec   36    219 KBytes
[ 15]   2.00-3.00   sec  23.0 MBytes   193 Mbits/sec    7    206 KBytes
[ 17]   2.00-3.00   sec  21.6 MBytes   181 Mbits/sec   45    192 KBytes
[ 19]   2.00-3.00   sec  22.5 MBytes   189 Mbits/sec   25    189 KBytes
[ 21]   2.00-3.00   sec  21.4 MBytes   179 Mbits/sec   45    187 KBytes
[ 23]   2.00-3.00   sec  19.6 MBytes   164 Mbits/sec   58    137 KBytes
[SUM]   2.00-3.00   sec   225 MBytes  1.89 Gbits/sec  374
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  30.9 MBytes   259 Mbits/sec   15    173 KBytes
[  7]   3.00-4.00   sec  31.3 MBytes   262 Mbits/sec   56    180 KBytes
[  9]   3.00-4.00   sec  28.4 MBytes   238 Mbits/sec   66    158 KBytes
[ 11]   3.00-4.00   sec  32.5 MBytes   272 Mbits/sec  149    187 KBytes
[ 13]   3.00-4.00   sec  25.0 MBytes   210 Mbits/sec   74    120 KBytes
[ 15]   3.00-4.00   sec  28.1 MBytes   235 Mbits/sec   23    151 KBytes
[ 17]   3.00-4.00   sec  30.3 MBytes   254 Mbits/sec   13    151 KBytes
[ 19]   3.00-4.00   sec  29.6 MBytes   248 Mbits/sec   17    148 KBytes
[ 21]   3.00-4.00   sec  29.6 MBytes   248 Mbits/sec   82    151 KBytes
[ 23]   3.00-4.00   sec  26.3 MBytes   221 Mbits/sec   60    156 KBytes
[SUM]   3.00-4.00   sec   292 MBytes  2.45 Gbits/sec  555
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  23.7 MBytes   199 Mbits/sec    9    146 KBytes
[  7]   4.00-5.00   sec  23.2 MBytes   195 Mbits/sec   36    147 KBytes
[  9]   4.00-5.00   sec  24.2 MBytes   203 Mbits/sec   22    157 KBytes
[ 11]   4.00-5.00   sec  23.5 MBytes   197 Mbits/sec   50    209 KBytes
[ 13]   4.00-5.00   sec  22.7 MBytes   191 Mbits/sec    0    218 KBytes
[ 15]   4.00-5.00   sec  23.7 MBytes   199 Mbits/sec    0    229 KBytes
[ 17]   4.00-5.00   sec  23.6 MBytes   198 Mbits/sec   28    164 KBytes
[ 19]   4.00-5.00   sec  23.6 MBytes   198 Mbits/sec   41    158 KBytes
[ 21]   4.00-5.00   sec  23.6 MBytes   198 Mbits/sec    0    235 KBytes
[ 23]   4.00-5.00   sec  21.9 MBytes   184 Mbits/sec   11    197 KBytes
[SUM]   4.00-5.00   sec   234 MBytes  1.96 Gbits/sec  197
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   133 MBytes   223 Mbits/sec   84             sender
[  5]   0.00-5.01   sec   131 MBytes   220 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   128 MBytes   215 Mbits/sec  177             sender
[  7]   0.00-5.01   sec   127 MBytes   213 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   127 MBytes   213 Mbits/sec  309             sender
[  9]   0.00-5.01   sec   126 MBytes   211 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   128 MBytes   215 Mbits/sec  233             sender
[ 11]   0.00-5.01   sec   127 MBytes   213 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   123 MBytes   207 Mbits/sec  182             sender
[ 13]   0.00-5.01   sec   122 MBytes   205 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   123 MBytes   206 Mbits/sec  146             sender
[ 15]   0.00-5.01   sec   122 MBytes   204 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   127 MBytes   213 Mbits/sec  132             sender
[ 17]   0.00-5.01   sec   126 MBytes   211 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   136 MBytes   228 Mbits/sec  169             sender
[ 19]   0.00-5.01   sec   134 MBytes   224 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   128 MBytes   215 Mbits/sec  191             sender
[ 21]   0.00-5.01   sec   127 MBytes   212 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   116 MBytes   195 Mbits/sec  221             sender
[ 23]   0.00-5.01   sec   115 MBytes   193 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.24 GBytes  2.13 Gbits/sec  1844             sender
[SUM]   0.00-5.01   sec  1.23 GBytes  2.10 Gbits/sec                  receiver

iperf Done.

Step 9: Run the command interfaces ethernet show counters on DUT0 and check whether the output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        156162  10338491          0      913665  1383219665          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run the command interfaces bonding show on DUT0 and check whether the output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.90

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping the IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.318 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.318/0.318/0.318/0.000 ms

Step 14: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.90

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run the command interfaces ethernet clear on DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect the following output on DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 47596 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 47600 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 47604 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 47620 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 47626 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 47640 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 47652 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 47658 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 47672 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 47684 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  27.6 MBytes   231 Mbits/sec    0    414 KBytes
[  7]   0.00-1.00   sec  33.2 MBytes   278 Mbits/sec    0    403 KBytes
[  9]   0.00-1.00   sec  38.6 MBytes   324 Mbits/sec    0    592 KBytes
[ 11]   0.00-1.00   sec  31.8 MBytes   266 Mbits/sec    0    448 KBytes
[ 13]   0.00-1.00   sec  29.0 MBytes   243 Mbits/sec    0    419 KBytes
[ 15]   0.00-1.00   sec  36.1 MBytes   303 Mbits/sec    0    570 KBytes
[ 17]   0.00-1.00   sec  50.8 MBytes   426 Mbits/sec    0   1.10 MBytes
[ 19]   0.00-1.00   sec  31.4 MBytes   263 Mbits/sec    0    447 KBytes
[ 21]   0.00-1.00   sec  25.9 MBytes   217 Mbits/sec    0    354 KBytes
[ 23]   0.00-1.00   sec  26.7 MBytes   224 Mbits/sec    0    397 KBytes
[SUM]   0.00-1.00   sec   331 MBytes  2.78 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  40.2 MBytes   337 Mbits/sec    0    561 KBytes
[  7]   1.00-2.00   sec  37.1 MBytes   311 Mbits/sec    0    512 KBytes
[  9]   1.00-2.00   sec  37.9 MBytes   318 Mbits/sec   44    329 KBytes
[ 11]   1.00-2.00   sec  36.0 MBytes   302 Mbits/sec   90    380 KBytes
[ 13]   1.00-2.00   sec  38.5 MBytes   323 Mbits/sec    4    380 KBytes
[ 15]   1.00-2.00   sec  39.2 MBytes   329 Mbits/sec   88    472 KBytes
[ 17]   1.00-2.00   sec  52.5 MBytes   441 Mbits/sec   90    865 KBytes
[ 19]   1.00-2.00   sec  36.2 MBytes   304 Mbits/sec    0    526 KBytes
[ 21]   1.00-2.00   sec  34.4 MBytes   288 Mbits/sec   45    334 KBytes
[ 23]   1.00-2.00   sec  34.6 MBytes   290 Mbits/sec   23    339 KBytes
[SUM]   1.00-2.00   sec   387 MBytes  3.24 Gbits/sec  384
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  44.1 MBytes   370 Mbits/sec    0    591 KBytes
[  7]   2.00-3.00   sec  41.8 MBytes   351 Mbits/sec    0    539 KBytes
[  9]   2.00-3.00   sec  38.0 MBytes   319 Mbits/sec    0    362 KBytes
[ 11]   2.00-3.00   sec  41.4 MBytes   348 Mbits/sec    0    417 KBytes
[ 13]   2.00-3.00   sec  37.3 MBytes   313 Mbits/sec    0    426 KBytes
[ 15]   2.00-3.00   sec  38.0 MBytes   319 Mbits/sec    3    358 KBytes
[ 17]   2.00-3.00   sec  45.0 MBytes   377 Mbits/sec  280    452 KBytes
[ 19]   2.00-3.00   sec  41.5 MBytes   348 Mbits/sec    0    526 KBytes
[ 21]   2.00-3.00   sec  37.9 MBytes   318 Mbits/sec   56    296 KBytes
[ 23]   2.00-3.00   sec  37.6 MBytes   315 Mbits/sec   32    281 KBytes
[SUM]   2.00-3.00   sec   403 MBytes  3.38 Gbits/sec  371
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  44.5 MBytes   373 Mbits/sec    0    619 KBytes
[  7]   3.00-4.00   sec  42.7 MBytes   358 Mbits/sec    0    594 KBytes
[  9]   3.00-4.00   sec  39.1 MBytes   328 Mbits/sec    0    380 KBytes
[ 11]   3.00-4.00   sec  42.6 MBytes   357 Mbits/sec    0    454 KBytes
[ 13]   3.00-4.00   sec  38.3 MBytes   321 Mbits/sec    0    462 KBytes
[ 15]   3.00-4.00   sec  38.8 MBytes   325 Mbits/sec    5    321 KBytes
[ 17]   3.00-4.00   sec  43.8 MBytes   367 Mbits/sec    0    498 KBytes
[ 19]   3.00-4.00   sec  41.8 MBytes   350 Mbits/sec    0    577 KBytes
[ 21]   3.00-4.00   sec  37.2 MBytes   312 Mbits/sec    0    327 KBytes
[ 23]   3.00-4.00   sec  36.2 MBytes   303 Mbits/sec    0    314 KBytes
[SUM]   3.00-4.00   sec   405 MBytes  3.40 Gbits/sec    5
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  30.0 MBytes   251 Mbits/sec    0    655 KBytes
[  7]   4.00-5.00   sec  29.6 MBytes   248 Mbits/sec    0    622 KBytes
[  9]   4.00-5.00   sec  28.1 MBytes   235 Mbits/sec    0    390 KBytes
[ 11]   4.00-5.00   sec  31.0 MBytes   260 Mbits/sec    0    465 KBytes
[ 13]   4.00-5.00   sec  29.1 MBytes   244 Mbits/sec    0    499 KBytes
[ 15]   4.00-5.00   sec  28.6 MBytes   240 Mbits/sec    0    339 KBytes
[ 17]   4.00-5.00   sec  30.0 MBytes   251 Mbits/sec    0    512 KBytes
[ 19]   4.00-5.00   sec  29.5 MBytes   247 Mbits/sec    0    607 KBytes
[ 21]   4.00-5.00   sec  28.2 MBytes   236 Mbits/sec    0    339 KBytes
[ 23]   4.00-5.00   sec  29.6 MBytes   248 Mbits/sec    0    335 KBytes
[SUM]   4.00-5.00   sec   294 MBytes  2.46 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   186 MBytes   313 Mbits/sec    0             sender
[  5]   0.00-5.01   sec   183 MBytes   307 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   184 MBytes   309 Mbits/sec    0             sender
[  7]   0.00-5.01   sec   182 MBytes   304 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   182 MBytes   305 Mbits/sec   44             sender
[  9]   0.00-5.01   sec   179 MBytes   299 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   183 MBytes   306 Mbits/sec   90             sender
[ 11]   0.00-5.01   sec   170 MBytes   284 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   172 MBytes   289 Mbits/sec    4             sender
[ 13]   0.00-5.01   sec   180 MBytes   301 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   181 MBytes   303 Mbits/sec   96             sender
[ 15]   0.00-5.01   sec   178 MBytes   298 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   222 MBytes   372 Mbits/sec  370             sender
[ 17]   0.00-5.01   sec   219 MBytes   367 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   180 MBytes   302 Mbits/sec    0             sender
[ 19]   0.00-5.01   sec   177 MBytes   297 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   164 MBytes   274 Mbits/sec  101             sender
[ 21]   0.00-5.01   sec   162 MBytes   270 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   165 MBytes   276 Mbits/sec   55             sender
[ 23]   0.00-5.01   sec   162 MBytes   272 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.78 GBytes  3.05 Gbits/sec  760             sender
[SUM]   0.00-5.01   sec  1.75 GBytes  3.00 Gbits/sec                  receiver

iperf Done.

Step 17: Run the command interfaces ethernet show counters on DUT0 and check whether the output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
-----------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets  Tx Bytes   Tx Errors
-----------------------------------------------------------------------------
eth0  up         42541   2816248          0      655503  992311722          0
eth1  up         90668   5978416          0      647650  980449701          0
eth2  down           0         0          0           0          0          0
eth3  down           0         0          0           0          0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.