Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test Hash-Policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run the command interfaces bonding show on DUT0 and check whether the output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping the IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.426 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.426/0.426/0.426/0.000 ms

Step 6: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run the command interfaces ethernet clear on DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect the following output on DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 34294 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 34302 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 34316 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 34326 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 34336 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 34338 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 34354 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 34356 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 34372 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 34388 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  44.4 MBytes   372 Mbits/sec    0    304 KBytes
[  7]   0.00-1.00   sec  44.6 MBytes   374 Mbits/sec    0    314 KBytes
[  9]   0.00-1.00   sec  45.7 MBytes   383 Mbits/sec    0    318 KBytes
[ 11]   0.00-1.00   sec  45.0 MBytes   377 Mbits/sec    0    327 KBytes
[ 13]   0.00-1.00   sec  44.9 MBytes   377 Mbits/sec    0    320 KBytes
[ 15]   0.00-1.00   sec  43.3 MBytes   363 Mbits/sec    0    256 KBytes
[ 17]   0.00-1.00   sec  43.1 MBytes   361 Mbits/sec    0    293 KBytes
[ 19]   0.00-1.00   sec  42.7 MBytes   358 Mbits/sec    0    267 KBytes
[ 21]   0.00-1.00   sec  42.7 MBytes   358 Mbits/sec    0    269 KBytes
[ 23]   0.00-1.00   sec  41.3 MBytes   346 Mbits/sec    0    180 KBytes
[SUM]   0.00-1.00   sec   438 MBytes  3.67 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  43.5 MBytes   365 Mbits/sec    0    304 KBytes
[  7]   1.00-2.00   sec  43.5 MBytes   365 Mbits/sec    0    314 KBytes
[  9]   1.00-2.00   sec  43.0 MBytes   361 Mbits/sec    0    318 KBytes
[ 11]   1.00-2.00   sec  43.4 MBytes   364 Mbits/sec    0    327 KBytes
[ 13]   1.00-2.00   sec  43.3 MBytes   363 Mbits/sec    0    320 KBytes
[ 15]   1.00-2.00   sec  43.3 MBytes   363 Mbits/sec    0    256 KBytes
[ 17]   1.00-2.00   sec  43.9 MBytes   368 Mbits/sec    0    293 KBytes
[ 19]   1.00-2.00   sec  43.7 MBytes   367 Mbits/sec    0    267 KBytes
[ 21]   1.00-2.00   sec  43.3 MBytes   363 Mbits/sec    0    269 KBytes
[ 23]   1.00-2.00   sec  44.0 MBytes   369 Mbits/sec    0    215 KBytes
[SUM]   1.00-2.00   sec   435 MBytes  3.65 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  47.2 MBytes   396 Mbits/sec    0    304 KBytes
[  7]   2.00-3.00   sec  47.2 MBytes   396 Mbits/sec    0    314 KBytes
[  9]   2.00-3.00   sec  47.7 MBytes   400 Mbits/sec    0    318 KBytes
[ 11]   2.00-3.00   sec  47.2 MBytes   396 Mbits/sec    0    327 KBytes
[ 13]   2.00-3.00   sec  47.8 MBytes   401 Mbits/sec    0    320 KBytes
[ 15]   2.00-3.00   sec  47.6 MBytes   399 Mbits/sec    0    256 KBytes
[ 17]   2.00-3.00   sec  46.9 MBytes   393 Mbits/sec    0    293 KBytes
[ 19]   2.00-3.00   sec  46.9 MBytes   393 Mbits/sec    0    267 KBytes
[ 21]   2.00-3.00   sec  47.5 MBytes   399 Mbits/sec    0    269 KBytes
[ 23]   2.00-3.00   sec  47.0 MBytes   395 Mbits/sec    0    215 KBytes
[SUM]   2.00-3.00   sec   473 MBytes  3.97 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  48.2 MBytes   405 Mbits/sec    0    304 KBytes
[  7]   3.00-4.00   sec  47.5 MBytes   399 Mbits/sec    0    314 KBytes
[  9]   3.00-4.00   sec  47.4 MBytes   397 Mbits/sec    0    318 KBytes
[ 11]   3.00-4.00   sec  47.8 MBytes   401 Mbits/sec    0    327 KBytes
[ 13]   3.00-4.00   sec  47.3 MBytes   397 Mbits/sec    0    320 KBytes
[ 15]   3.00-4.00   sec  47.3 MBytes   397 Mbits/sec    0    256 KBytes
[ 17]   3.00-4.00   sec  47.7 MBytes   400 Mbits/sec    0    293 KBytes
[ 19]   3.00-4.00   sec  48.1 MBytes   403 Mbits/sec    0    267 KBytes
[ 21]   3.00-4.00   sec  47.5 MBytes   398 Mbits/sec    0    269 KBytes
[ 23]   3.00-4.00   sec  48.0 MBytes   402 Mbits/sec    0    215 KBytes
[SUM]   3.00-4.00   sec   477 MBytes  4.00 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  48.8 MBytes   409 Mbits/sec    0    304 KBytes
[  7]   4.00-5.00   sec  49.7 MBytes   416 Mbits/sec    0    314 KBytes
[  9]   4.00-5.00   sec  49.0 MBytes   411 Mbits/sec    0    318 KBytes
[ 11]   4.00-5.00   sec  48.8 MBytes   409 Mbits/sec    0    327 KBytes
[ 13]   4.00-5.00   sec  49.2 MBytes   413 Mbits/sec    0    320 KBytes
[ 15]   4.00-5.00   sec  49.2 MBytes   413 Mbits/sec    0    256 KBytes
[ 17]   4.00-5.00   sec  49.0 MBytes   411 Mbits/sec    0    293 KBytes
[ 19]   4.00-5.00   sec  48.8 MBytes   409 Mbits/sec    0    267 KBytes
[ 21]   4.00-5.00   sec  49.4 MBytes   414 Mbits/sec    0    269 KBytes
[ 23]   4.00-5.00   sec  49.0 MBytes   411 Mbits/sec    0    215 KBytes
[SUM]   4.00-5.00   sec   491 MBytes  4.12 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   232 MBytes   389 Mbits/sec    0             sender
[  5]   0.00-5.00   sec   229 MBytes   385 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   232 MBytes   390 Mbits/sec    0             sender
[  7]   0.00-5.00   sec   229 MBytes   385 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   233 MBytes   390 Mbits/sec    0             sender
[  9]   0.00-5.00   sec   230 MBytes   386 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   232 MBytes   390 Mbits/sec    0             sender
[ 11]   0.00-5.00   sec   230 MBytes   385 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   233 MBytes   390 Mbits/sec    0             sender
[ 13]   0.00-5.00   sec   229 MBytes   385 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   231 MBytes   387 Mbits/sec    0             sender
[ 15]   0.00-5.00   sec   229 MBytes   384 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   230 MBytes   387 Mbits/sec    0             sender
[ 17]   0.00-5.00   sec   229 MBytes   383 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   230 MBytes   386 Mbits/sec    0             sender
[ 19]   0.00-5.00   sec   228 MBytes   383 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   230 MBytes   386 Mbits/sec    0             sender
[ 21]   0.00-5.00   sec   228 MBytes   382 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   229 MBytes   385 Mbits/sec    0             sender
[ 23]   0.00-5.00   sec   228 MBytes   382 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  2.26 GBytes  3.88 Gbits/sec    0             sender
[SUM]   0.00-5.00   sec  2.24 GBytes  3.84 Gbits/sec                  receiver

iperf Done.

Step 9: Run the command interfaces ethernet show counters on DUT0 and check whether the output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up         22696   1499536          0     1675243  2523682314          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run the command interfaces bonding show on DUT0 and check whether the output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping the IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.610 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.610/0.610/0.610/0.000 ms

Step 14: Run the command interfaces bonding bond0 show ports on DUT0 and check whether the output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run the command interfaces ethernet clear on DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect the following output on DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 34412 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 34426 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 34434 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 34442 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 34456 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 34464 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 34472 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 34480 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 34496 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 34508 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  40.0 MBytes   335 Mbits/sec    0    421 KBytes
[  7]   0.00-1.00   sec  93.9 MBytes   787 Mbits/sec    0    776 KBytes
[  9]   0.00-1.00   sec  87.2 MBytes   732 Mbits/sec    0    766 KBytes
[ 11]   0.00-1.00   sec  86.8 MBytes   728 Mbits/sec    0    810 KBytes
[ 13]   0.00-1.00   sec  39.0 MBytes   327 Mbits/sec    0    457 KBytes
[ 15]   0.00-1.00   sec  40.5 MBytes   339 Mbits/sec    0    376 KBytes
[ 17]   0.00-1.00   sec  41.2 MBytes   346 Mbits/sec    1    443 KBytes
[ 19]   0.00-1.00   sec  41.2 MBytes   346 Mbits/sec    1    433 KBytes
[ 21]   0.00-1.00   sec  42.1 MBytes   353 Mbits/sec    0    475 KBytes
[ 23]   0.00-1.00   sec  42.3 MBytes   354 Mbits/sec    0    440 KBytes
[SUM]   0.00-1.00   sec   554 MBytes  4.65 Gbits/sec    2
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  35.9 MBytes   301 Mbits/sec   45    355 KBytes
[  7]   1.00-2.00   sec  81.2 MBytes   682 Mbits/sec    0    970 KBytes
[  9]   1.00-2.00   sec  78.8 MBytes   661 Mbits/sec    0    986 KBytes
[ 11]   1.00-2.00   sec  80.0 MBytes   671 Mbits/sec    0    986 KBytes
[ 13]   1.00-2.00   sec  36.5 MBytes   307 Mbits/sec   45    379 KBytes
[ 15]   1.00-2.00   sec  36.6 MBytes   307 Mbits/sec    0    478 KBytes
[ 17]   1.00-2.00   sec  36.1 MBytes   303 Mbits/sec   45    373 KBytes
[ 19]   1.00-2.00   sec  35.9 MBytes   301 Mbits/sec   45    361 KBytes
[ 21]   1.00-2.00   sec  36.2 MBytes   303 Mbits/sec   45    396 KBytes
[ 23]   1.00-2.00   sec  36.0 MBytes   302 Mbits/sec   50    368 KBytes
[SUM]   1.00-2.00   sec   493 MBytes  4.14 Gbits/sec  275
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  38.7 MBytes   325 Mbits/sec    6    290 KBytes
[  7]   2.00-3.00   sec  86.2 MBytes   724 Mbits/sec    0   1020 KBytes
[  9]   2.00-3.00   sec  82.5 MBytes   692 Mbits/sec   39    723 KBytes
[ 11]   2.00-3.00   sec  85.0 MBytes   713 Mbits/sec    0   1.01 MBytes
[ 13]   2.00-3.00   sec  39.6 MBytes   332 Mbits/sec    0    392 KBytes
[ 15]   2.00-3.00   sec  40.8 MBytes   342 Mbits/sec    0    551 KBytes
[ 17]   2.00-3.00   sec  38.0 MBytes   319 Mbits/sec   45    321 KBytes
[ 19]   2.00-3.00   sec  40.4 MBytes   339 Mbits/sec   44    308 KBytes
[ 21]   2.00-3.00   sec  38.7 MBytes   325 Mbits/sec   45    322 KBytes
[ 23]   2.00-3.00   sec  39.5 MBytes   332 Mbits/sec   45    317 KBytes
[SUM]   2.00-3.00   sec   529 MBytes  4.44 Gbits/sec  224
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  40.5 MBytes   339 Mbits/sec    0    308 KBytes
[  7]   3.00-4.00   sec  90.0 MBytes   755 Mbits/sec    0   1.04 MBytes
[  9]   3.00-4.00   sec  85.0 MBytes   713 Mbits/sec    0    819 KBytes
[ 11]   3.00-4.00   sec  88.8 MBytes   744 Mbits/sec    0   1.06 MBytes
[ 13]   3.00-4.00   sec  40.2 MBytes   337 Mbits/sec    0    441 KBytes
[ 15]   3.00-4.00   sec  41.6 MBytes   349 Mbits/sec    0    605 KBytes
[ 17]   3.00-4.00   sec  37.8 MBytes   317 Mbits/sec    4    277 KBytes
[ 19]   3.00-4.00   sec  39.6 MBytes   333 Mbits/sec    0    325 KBytes
[ 21]   3.00-4.00   sec  39.5 MBytes   332 Mbits/sec   24    288 KBytes
[ 23]   3.00-4.00   sec  38.7 MBytes   324 Mbits/sec    0    331 KBytes
[SUM]   3.00-4.00   sec   542 MBytes  4.54 Gbits/sec   28
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  36.4 MBytes   305 Mbits/sec   44    272 KBytes
[  7]   4.00-5.00   sec  81.2 MBytes   682 Mbits/sec    0   1.04 MBytes
[  9]   4.00-5.00   sec  73.8 MBytes   619 Mbits/sec    0    841 KBytes
[ 11]   4.00-5.00   sec  80.0 MBytes   671 Mbits/sec    0   1.06 MBytes
[ 13]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec    0    448 KBytes
[ 15]   4.00-5.00   sec  37.0 MBytes   310 Mbits/sec    0    605 KBytes
[ 17]   4.00-5.00   sec  34.4 MBytes   288 Mbits/sec   19    260 KBytes
[ 19]   4.00-5.00   sec  35.8 MBytes   300 Mbits/sec   31    281 KBytes
[ 21]   4.00-5.00   sec  36.5 MBytes   307 Mbits/sec    0    308 KBytes
[ 23]   4.00-5.00   sec  36.1 MBytes   303 Mbits/sec    0    341 KBytes
[SUM]   4.00-5.00   sec   488 MBytes  4.10 Gbits/sec   94
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   191 MBytes   321 Mbits/sec   95             sender
[  5]   0.00-5.00   sec   189 MBytes   317 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   433 MBytes   726 Mbits/sec    0             sender
[  7]   0.00-5.00   sec   429 MBytes   720 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   407 MBytes   683 Mbits/sec   39             sender
[  9]   0.00-5.00   sec   405 MBytes   678 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   420 MBytes   705 Mbits/sec    0             sender
[ 11]   0.00-5.00   sec   417 MBytes   699 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   192 MBytes   323 Mbits/sec   45             sender
[ 13]   0.00-5.00   sec   190 MBytes   319 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   196 MBytes   330 Mbits/sec    0             sender
[ 15]   0.00-5.00   sec   194 MBytes   326 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   188 MBytes   315 Mbits/sec  114             sender
[ 17]   0.00-5.00   sec   186 MBytes   311 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   193 MBytes   324 Mbits/sec  121             sender
[ 19]   0.00-5.00   sec   191 MBytes   321 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   193 MBytes   324 Mbits/sec  114             sender
[ 21]   0.00-5.00   sec   190 MBytes   319 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   193 MBytes   323 Mbits/sec   95             sender
[ 23]   0.00-5.00   sec   191 MBytes   320 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  2.55 GBytes  4.37 Gbits/sec  623             sender
[SUM]   0.00-5.00   sec  2.52 GBytes  4.33 Gbits/sec                  receiver

iperf Done.

Step 17: Run the command interfaces ethernet show counters on DUT0 and check whether the output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up         65339   4311857          0      965949  1462332604          0
eth1  up         81438   5369209          0      906610  1372552819          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.