Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=465 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 464.531/464.531/464.531/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 41300 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 41314 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 41330 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 41334 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 41340 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 41344 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 41356 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 41362 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 41370 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 41380 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  27.0 MBytes   226 Mbits/sec    0    663 KBytes
[  7]   0.00-1.00   sec  26.6 MBytes   223 Mbits/sec    0    970 KBytes
[  9]   0.00-1.00   sec  21.8 MBytes   183 Mbits/sec    0    324 KBytes
[ 11]   0.00-1.00   sec  21.4 MBytes   179 Mbits/sec    0    324 KBytes
[ 13]   0.00-1.00   sec  21.4 MBytes   179 Mbits/sec    0    325 KBytes
[ 15]   0.00-1.00   sec  21.2 MBytes   178 Mbits/sec    0    321 KBytes
[ 17]   0.00-1.00   sec  21.6 MBytes   181 Mbits/sec    0    322 KBytes
[ 19]   0.00-1.00   sec  21.2 MBytes   178 Mbits/sec    0    315 KBytes
[ 21]   0.00-1.00   sec  21.1 MBytes   177 Mbits/sec    0    314 KBytes
[ 23]   0.00-1.00   sec  20.8 MBytes   175 Mbits/sec    0    324 KBytes
[SUM]   0.00-1.00   sec   224 MBytes  1.88 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  18.8 MBytes   157 Mbits/sec    0    663 KBytes
[  7]   1.00-2.00   sec  18.8 MBytes   157 Mbits/sec    0    970 KBytes
[  9]   1.00-2.00   sec  19.3 MBytes   162 Mbits/sec    0    385 KBytes
[ 11]   1.00-2.00   sec  19.3 MBytes   162 Mbits/sec    0    356 KBytes
[ 13]   1.00-2.00   sec  19.3 MBytes   162 Mbits/sec    0    386 KBytes
[ 15]   1.00-2.00   sec  19.4 MBytes   163 Mbits/sec    0    382 KBytes
[ 17]   1.00-2.00   sec  19.1 MBytes   160 Mbits/sec    0    387 KBytes
[ 19]   1.00-2.00   sec  18.7 MBytes   157 Mbits/sec    0    389 KBytes
[ 21]   1.00-2.00   sec  19.3 MBytes   162 Mbits/sec    0    390 KBytes
[ 23]   1.00-2.00   sec  19.5 MBytes   163 Mbits/sec    0    385 KBytes
[SUM]   1.00-2.00   sec   191 MBytes  1.60 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  30.0 MBytes   252 Mbits/sec  270    341 KBytes
[  7]   2.00-3.00   sec  31.2 MBytes   262 Mbits/sec  450    494 KBytes
[  9]   2.00-3.00   sec  29.5 MBytes   248 Mbits/sec  143    204 KBytes
[ 11]   2.00-3.00   sec  29.4 MBytes   247 Mbits/sec   90    199 KBytes
[ 13]   2.00-3.00   sec  29.3 MBytes   246 Mbits/sec   90    206 KBytes
[ 15]   2.00-3.00   sec  29.3 MBytes   246 Mbits/sec  135    205 KBytes
[ 17]   2.00-3.00   sec  29.4 MBytes   247 Mbits/sec  135    206 KBytes
[ 19]   2.00-3.00   sec  29.5 MBytes   247 Mbits/sec  146    209 KBytes
[ 21]   2.00-3.00   sec  29.6 MBytes   249 Mbits/sec   90    209 KBytes
[ 23]   2.00-3.00   sec  29.5 MBytes   247 Mbits/sec   90    206 KBytes
[SUM]   2.00-3.00   sec   297 MBytes  2.49 Gbits/sec  1639
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  41.2 MBytes   346 Mbits/sec   58    247 KBytes
[  7]   3.00-4.00   sec  41.2 MBytes   346 Mbits/sec   67    239 KBytes
[  9]   3.00-4.00   sec  34.3 MBytes   288 Mbits/sec  103    184 KBytes
[ 11]   3.00-4.00   sec  37.4 MBytes   314 Mbits/sec   17    201 KBytes
[ 13]   3.00-4.00   sec  39.2 MBytes   329 Mbits/sec    2    263 KBytes
[ 15]   3.00-4.00   sec  36.6 MBytes   307 Mbits/sec   10    235 KBytes
[ 17]   3.00-4.00   sec  35.8 MBytes   300 Mbits/sec   77    164 KBytes
[ 19]   3.00-4.00   sec  34.9 MBytes   293 Mbits/sec  102    132 KBytes
[ 21]   3.00-4.00   sec  36.0 MBytes   302 Mbits/sec   45    168 KBytes
[ 23]   3.00-4.00   sec  39.5 MBytes   331 Mbits/sec    5    236 KBytes
[SUM]   3.00-4.00   sec   376 MBytes  3.16 Gbits/sec  486
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  40.0 MBytes   336 Mbits/sec  113    184 KBytes
[  7]   4.00-5.00   sec  40.0 MBytes   336 Mbits/sec   85    184 KBytes
[  9]   4.00-5.00   sec  39.5 MBytes   331 Mbits/sec   59    174 KBytes
[ 11]   4.00-5.00   sec  39.4 MBytes   330 Mbits/sec   47    178 KBytes
[ 13]   4.00-5.00   sec  40.0 MBytes   335 Mbits/sec   17    185 KBytes
[ 15]   4.00-5.00   sec  40.1 MBytes   337 Mbits/sec   66    259 KBytes
[ 17]   4.00-5.00   sec  40.1 MBytes   337 Mbits/sec   53    238 KBytes
[ 19]   4.00-5.00   sec  39.0 MBytes   327 Mbits/sec   27    189 KBytes
[ 21]   4.00-5.00   sec  39.3 MBytes   329 Mbits/sec   57    173 KBytes
[ 23]   4.00-5.00   sec  40.1 MBytes   337 Mbits/sec   82    184 KBytes
[SUM]   4.00-5.00   sec   398 MBytes  3.33 Gbits/sec  606
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   157 MBytes   263 Mbits/sec  441             sender
[  5]   0.00-5.00   sec   153 MBytes   257 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   158 MBytes   265 Mbits/sec  602             sender
[  7]   0.00-5.00   sec   155 MBytes   259 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   144 MBytes   242 Mbits/sec  305             sender
[  9]   0.00-5.00   sec   143 MBytes   239 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   147 MBytes   246 Mbits/sec  154             sender
[ 11]   0.00-5.00   sec   145 MBytes   244 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   149 MBytes   250 Mbits/sec  109             sender
[ 13]   0.00-5.00   sec   147 MBytes   247 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   147 MBytes   246 Mbits/sec  211             sender
[ 15]   0.00-5.00   sec   145 MBytes   243 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   146 MBytes   245 Mbits/sec  265             sender
[ 17]   0.00-5.00   sec   144 MBytes   241 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   143 MBytes   240 Mbits/sec  275             sender
[ 19]   0.00-5.00   sec   142 MBytes   238 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   145 MBytes   244 Mbits/sec  192             sender
[ 21]   0.00-5.00   sec   144 MBytes   241 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   149 MBytes   251 Mbits/sec  177             sender
[ 23]   0.00-5.00   sec   148 MBytes   248 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.45 GBytes  2.49 Gbits/sec  2731             sender
[SUM]   0.00-5.00   sec  1.43 GBytes  2.46 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        229717  15183175          0     1065050  1612413659          0
eth1  up             0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.280 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 53084 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 53096 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 53100 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 53112 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 53120 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 53128 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 53136 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 53140 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 53148 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 53150 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  28.1 MBytes   236 Mbits/sec    0    365 KBytes
[  7]   0.00-1.00   sec  27.8 MBytes   233 Mbits/sec    0    354 KBytes
[  9]   0.00-1.00   sec  27.9 MBytes   234 Mbits/sec    0    361 KBytes
[ 11]   0.00-1.00   sec  29.3 MBytes   245 Mbits/sec    0    355 KBytes
[ 13]   0.00-1.00   sec  27.9 MBytes   234 Mbits/sec    0    341 KBytes
[ 15]   0.00-1.00   sec  28.3 MBytes   237 Mbits/sec    0    354 KBytes
[ 17]   0.00-1.00   sec  29.6 MBytes   248 Mbits/sec    0    443 KBytes
[ 19]   0.00-1.00   sec  29.7 MBytes   249 Mbits/sec    0    410 KBytes
[ 21]   0.00-1.00   sec  26.5 MBytes   222 Mbits/sec    0    338 KBytes
[ 23]   0.00-1.00   sec   151 MBytes  1.27 Gbits/sec    0   1.09 MBytes
[SUM]   0.00-1.00   sec   406 MBytes  3.41 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  30.3 MBytes   254 Mbits/sec  246    175 KBytes
[  7]   1.00-2.00   sec  30.3 MBytes   254 Mbits/sec  226    174 KBytes
[  9]   1.00-2.00   sec  31.7 MBytes   266 Mbits/sec  360    223 KBytes
[ 11]   1.00-2.00   sec  31.4 MBytes   264 Mbits/sec  251    226 KBytes
[ 13]   1.00-2.00   sec  32.9 MBytes   276 Mbits/sec  169    212 KBytes
[ 15]   1.00-2.00   sec  30.3 MBytes   254 Mbits/sec  231    173 KBytes
[ 17]   1.00-2.00   sec  34.0 MBytes   285 Mbits/sec  217    247 KBytes
[ 19]   1.00-2.00   sec  32.7 MBytes   274 Mbits/sec  286    240 KBytes
[ 21]   1.00-2.00   sec  31.0 MBytes   260 Mbits/sec  237    222 KBytes
[ 23]   1.00-2.00   sec   115 MBytes   965 Mbits/sec  578    471 KBytes
[SUM]   1.00-2.00   sec   400 MBytes  3.35 Gbits/sec  2801
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  37.3 MBytes   313 Mbits/sec   16    198 KBytes
[  7]   2.00-3.00   sec  33.7 MBytes   283 Mbits/sec  105    129 KBytes
[  9]   2.00-3.00   sec  36.1 MBytes   303 Mbits/sec   91    189 KBytes
[ 11]   2.00-3.00   sec  34.5 MBytes   289 Mbits/sec   67    173 KBytes
[ 13]   2.00-3.00   sec  35.7 MBytes   299 Mbits/sec  149    188 KBytes
[ 15]   2.00-3.00   sec  32.1 MBytes   270 Mbits/sec  107    161 KBytes
[ 17]   2.00-3.00   sec  39.5 MBytes   332 Mbits/sec   48    221 KBytes
[ 19]   2.00-3.00   sec  36.8 MBytes   309 Mbits/sec   93    192 KBytes
[ 21]   2.00-3.00   sec  36.7 MBytes   308 Mbits/sec   30    188 KBytes
[ 23]   2.00-3.00   sec  96.2 MBytes   807 Mbits/sec  162    273 KBytes
[SUM]   2.00-3.00   sec   419 MBytes  3.51 Gbits/sec  868
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  37.9 MBytes   318 Mbits/sec   12    238 KBytes
[  7]   3.00-4.00   sec  33.9 MBytes   284 Mbits/sec   43    205 KBytes
[  9]   3.00-4.00   sec  34.1 MBytes   286 Mbits/sec   53    206 KBytes
[ 11]   3.00-4.00   sec  33.9 MBytes   285 Mbits/sec   45    182 KBytes
[ 13]   3.00-4.00   sec  33.7 MBytes   283 Mbits/sec   32    202 KBytes
[ 15]   3.00-4.00   sec  32.9 MBytes   276 Mbits/sec   44    199 KBytes
[ 17]   3.00-4.00   sec  35.8 MBytes   300 Mbits/sec   37    215 KBytes
[ 19]   3.00-4.00   sec  33.8 MBytes   284 Mbits/sec   13    209 KBytes
[ 21]   3.00-4.00   sec  34.6 MBytes   290 Mbits/sec   48    184 KBytes
[ 23]   3.00-4.00   sec   101 MBytes   849 Mbits/sec   19    351 KBytes
[SUM]   3.00-4.00   sec   412 MBytes  3.45 Gbits/sec  346
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  36.8 MBytes   309 Mbits/sec   75    279 KBytes
[  7]   4.00-5.00   sec  31.8 MBytes   266 Mbits/sec   26    148 KBytes
[  9]   4.00-5.00   sec  33.2 MBytes   279 Mbits/sec   60    194 KBytes
[ 11]   4.00-5.00   sec  33.1 MBytes   278 Mbits/sec   39    255 KBytes
[ 13]   4.00-5.00   sec  30.4 MBytes   255 Mbits/sec  118    158 KBytes
[ 15]   4.00-5.00   sec  30.3 MBytes   254 Mbits/sec   13    153 KBytes
[ 17]   4.00-5.00   sec  33.1 MBytes   277 Mbits/sec   79    194 KBytes
[ 19]   4.00-5.00   sec  34.1 MBytes   286 Mbits/sec   51    197 KBytes
[ 21]   4.00-5.00   sec  33.4 MBytes   280 Mbits/sec   56    168 KBytes
[ 23]   4.00-5.00   sec  96.2 MBytes   807 Mbits/sec   76    287 KBytes
[SUM]   4.00-5.00   sec   392 MBytes  3.29 Gbits/sec  593
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   170 MBytes   286 Mbits/sec  349             sender
[  5]   0.00-5.01   sec   169 MBytes   282 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   157 MBytes   264 Mbits/sec  400             sender
[  7]   0.00-5.01   sec   156 MBytes   261 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   163 MBytes   273 Mbits/sec  564             sender
[  9]   0.00-5.01   sec   161 MBytes   270 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   162 MBytes   272 Mbits/sec  402             sender
[ 11]   0.00-5.01   sec   161 MBytes   269 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   161 MBytes   270 Mbits/sec  468             sender
[ 13]   0.00-5.01   sec   159 MBytes   267 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   154 MBytes   258 Mbits/sec  395             sender
[ 15]   0.00-5.01   sec   152 MBytes   255 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   172 MBytes   288 Mbits/sec  381             sender
[ 17]   0.00-5.01   sec   170 MBytes   284 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   167 MBytes   280 Mbits/sec  443             sender
[ 19]   0.00-5.01   sec   165 MBytes   276 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   162 MBytes   272 Mbits/sec  371             sender
[ 21]   0.00-5.01   sec   161 MBytes   270 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   560 MBytes   939 Mbits/sec  835             sender
[ 23]   0.00-5.01   sec   556 MBytes   932 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.98 GBytes  3.40 Gbits/sec  4608             sender
[SUM]   0.00-5.01   sec  1.96 GBytes  3.37 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        254782  16850585          0     1057577  1601061935          0
eth1  up        124856   8260220          0      403927   611506398          0

Note

As you can see, this time traffic is going out through both bonded interfaces.