Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=427 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 427.213/427.213/427.213/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 54030 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 54044 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 54058 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 54070 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 54082 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 54098 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 54112 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 54116 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 54124 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 54140 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  36.6 MBytes   307 Mbits/sec  155    165 KBytes
[  7]   0.00-1.00   sec  41.7 MBytes   350 Mbits/sec   48    257 KBytes
[  9]   0.00-1.00   sec  39.8 MBytes   334 Mbits/sec   76    235 KBytes
[ 11]   0.00-1.00   sec  39.6 MBytes   332 Mbits/sec  120    163 KBytes
[ 13]   0.00-1.00   sec  31.4 MBytes   264 Mbits/sec   47    219 KBytes
[ 15]   0.00-1.00   sec  31.0 MBytes   260 Mbits/sec   47    163 KBytes
[ 17]   0.00-1.00   sec  24.2 MBytes   203 Mbits/sec   27    144 KBytes
[ 19]   0.00-1.00   sec  38.9 MBytes   327 Mbits/sec   93    192 KBytes
[ 21]   0.00-1.00   sec  25.2 MBytes   211 Mbits/sec   45    153 KBytes
[ 23]   0.00-1.00   sec  34.0 MBytes   285 Mbits/sec   76    214 KBytes
[SUM]   0.00-1.00   sec   342 MBytes  2.87 Gbits/sec  734
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  37.7 MBytes   316 Mbits/sec   55    173 KBytes
[  7]   1.00-2.00   sec  40.6 MBytes   341 Mbits/sec   98    195 KBytes
[  9]   1.00-2.00   sec  39.3 MBytes   330 Mbits/sec  102    188 KBytes
[ 11]   1.00-2.00   sec  34.2 MBytes   287 Mbits/sec   48    194 KBytes
[ 13]   1.00-2.00   sec  38.7 MBytes   324 Mbits/sec   39    243 KBytes
[ 15]   1.00-2.00   sec  35.5 MBytes   298 Mbits/sec   53    167 KBytes
[ 17]   1.00-2.00   sec  36.4 MBytes   305 Mbits/sec   33    228 KBytes
[ 19]   1.00-2.00   sec  37.0 MBytes   310 Mbits/sec   47    165 KBytes
[ 21]   1.00-2.00   sec  34.4 MBytes   289 Mbits/sec   58    160 KBytes
[ 23]   1.00-2.00   sec  37.4 MBytes   314 Mbits/sec  112    174 KBytes
[SUM]   1.00-2.00   sec   371 MBytes  3.11 Gbits/sec  645
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  39.3 MBytes   330 Mbits/sec    9    245 KBytes
[  7]   2.00-3.00   sec  42.5 MBytes   357 Mbits/sec   19    247 KBytes
[  9]   2.00-3.00   sec  37.2 MBytes   312 Mbits/sec   27    218 KBytes
[ 11]   2.00-3.00   sec  40.5 MBytes   340 Mbits/sec   12    257 KBytes
[ 13]   2.00-3.00   sec  48.2 MBytes   404 Mbits/sec    0    325 KBytes
[ 15]   2.00-3.00   sec  34.5 MBytes   289 Mbits/sec   30    212 KBytes
[ 17]   2.00-3.00   sec  40.7 MBytes   341 Mbits/sec    5    263 KBytes
[ 19]   2.00-3.00   sec  39.1 MBytes   328 Mbits/sec    6    238 KBytes
[ 21]   2.00-3.00   sec  33.2 MBytes   278 Mbits/sec   57    215 KBytes
[ 23]   2.00-3.00   sec  28.4 MBytes   238 Mbits/sec   67    184 KBytes
[SUM]   2.00-3.00   sec   384 MBytes  3.22 Gbits/sec  232
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  39.6 MBytes   333 Mbits/sec   52    192 KBytes
[  7]   3.00-4.00   sec  38.8 MBytes   325 Mbits/sec   35    194 KBytes
[  9]   3.00-4.00   sec  37.5 MBytes   314 Mbits/sec   67    187 KBytes
[ 11]   3.00-4.00   sec  39.3 MBytes   330 Mbits/sec  103    189 KBytes
[ 13]   3.00-4.00   sec  41.4 MBytes   348 Mbits/sec  117    208 KBytes
[ 15]   3.00-4.00   sec  44.2 MBytes   371 Mbits/sec   24    242 KBytes
[ 17]   3.00-4.00   sec  41.1 MBytes   345 Mbits/sec  117    243 KBytes
[ 19]   3.00-4.00   sec  41.1 MBytes   345 Mbits/sec   76    208 KBytes
[ 21]   3.00-4.00   sec  40.3 MBytes   338 Mbits/sec   47    202 KBytes
[ 23]   3.00-4.00   sec  39.0 MBytes   327 Mbits/sec   16    195 KBytes
[SUM]   3.00-4.00   sec   402 MBytes  3.38 Gbits/sec  654
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  37.3 MBytes   313 Mbits/sec   46    198 KBytes
[  7]   4.00-5.00   sec  38.5 MBytes   323 Mbits/sec  132    197 KBytes
[  9]   4.00-5.00   sec  40.8 MBytes   342 Mbits/sec   47    219 KBytes
[ 11]   4.00-5.00   sec  35.7 MBytes   300 Mbits/sec   32    153 KBytes
[ 13]   4.00-5.00   sec  40.5 MBytes   340 Mbits/sec   16    274 KBytes
[ 15]   4.00-5.00   sec  33.5 MBytes   281 Mbits/sec   62    146 KBytes
[ 17]   4.00-5.00   sec  36.2 MBytes   304 Mbits/sec   99    187 KBytes
[ 19]   4.00-5.00   sec  35.4 MBytes   297 Mbits/sec   75    170 KBytes
[ 21]   4.00-5.00   sec  33.2 MBytes   279 Mbits/sec   29    197 KBytes
[ 23]   4.00-5.00   sec  34.0 MBytes   285 Mbits/sec   85    164 KBytes
[SUM]   4.00-5.00   sec   365 MBytes  3.06 Gbits/sec  623
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   191 MBytes   320 Mbits/sec  317             sender
[  5]   0.00-5.01   sec   189 MBytes   317 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   202 MBytes   339 Mbits/sec  332             sender
[  7]   0.00-5.01   sec   200 MBytes   336 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   195 MBytes   326 Mbits/sec  319             sender
[  9]   0.00-5.01   sec   193 MBytes   323 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   189 MBytes   318 Mbits/sec  315             sender
[ 11]   0.00-5.01   sec   187 MBytes   314 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   200 MBytes   336 Mbits/sec  219             sender
[ 13]   0.00-5.01   sec   199 MBytes   333 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   179 MBytes   300 Mbits/sec  216             sender
[ 15]   0.00-5.01   sec   178 MBytes   298 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   179 MBytes   300 Mbits/sec  281             sender
[ 17]   0.00-5.01   sec   177 MBytes   297 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   192 MBytes   321 Mbits/sec  297             sender
[ 19]   0.00-5.01   sec   190 MBytes   318 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   166 MBytes   279 Mbits/sec  236             sender
[ 21]   0.00-5.01   sec   165 MBytes   276 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   173 MBytes   290 Mbits/sec  356             sender
[ 23]   0.00-5.01   sec   171 MBytes   287 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.82 GBytes  3.13 Gbits/sec  2888             sender
[SUM]   0.00-5.01   sec  1.81 GBytes  3.10 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        227958  15076811          0     1343777  2034403445          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.641 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.641/0.641/0.641/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.74

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 42978 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 42982 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 42986 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 42996 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 43008 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 43010 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 43026 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 43028 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 43032 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 43042 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  39.5 MBytes   331 Mbits/sec    6    175 KBytes
[  7]   0.00-1.00   sec  44.7 MBytes   375 Mbits/sec   14    192 KBytes
[  9]   0.00-1.00   sec  57.9 MBytes   485 Mbits/sec   90    474 KBytes
[ 11]   0.00-1.00   sec  46.9 MBytes   394 Mbits/sec   14    199 KBytes
[ 13]   0.00-1.00   sec  46.4 MBytes   389 Mbits/sec   11    205 KBytes
[ 15]   0.00-1.00   sec  47.3 MBytes   397 Mbits/sec  102    195 KBytes
[ 17]   0.00-1.00   sec  47.2 MBytes   396 Mbits/sec   20    205 KBytes
[ 19]   0.00-1.00   sec  47.1 MBytes   395 Mbits/sec   71    201 KBytes
[ 21]   0.00-1.00   sec  46.7 MBytes   391 Mbits/sec   46    198 KBytes
[ 23]   0.00-1.00   sec  38.5 MBytes   323 Mbits/sec   44    191 KBytes
[SUM]   0.00-1.00   sec   462 MBytes  3.88 Gbits/sec  418
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  44.4 MBytes   373 Mbits/sec    0    202 KBytes
[  7]   1.00-2.00   sec  44.2 MBytes   371 Mbits/sec    0    206 KBytes
[  9]   1.00-2.00   sec  43.8 MBytes   367 Mbits/sec    0    474 KBytes
[ 11]   1.00-2.00   sec  44.2 MBytes   371 Mbits/sec    0    206 KBytes
[ 13]   1.00-2.00   sec  43.9 MBytes   368 Mbits/sec    0    218 KBytes
[ 15]   1.00-2.00   sec  44.0 MBytes   369 Mbits/sec    0    209 KBytes
[ 17]   1.00-2.00   sec  43.8 MBytes   368 Mbits/sec    0    214 KBytes
[ 19]   1.00-2.00   sec  44.2 MBytes   371 Mbits/sec    0    214 KBytes
[ 21]   1.00-2.00   sec  44.4 MBytes   373 Mbits/sec    0    221 KBytes
[ 23]   1.00-2.00   sec  44.4 MBytes   372 Mbits/sec    0    206 KBytes
[SUM]   1.00-2.00   sec   441 MBytes  3.70 Gbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[  7]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[  9]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[ 11]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[ 13]   2.00-3.00   sec   509 KBytes  4.17 Mbits/sec    3   1.41 KBytes
[ 15]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[ 17]   2.00-3.00   sec   636 KBytes  5.21 Mbits/sec    4   1.41 KBytes
[ 19]   2.00-3.00   sec   636 KBytes  5.21 Mbits/sec    3   1.41 KBytes
[ 21]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[ 23]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    3   1.41 KBytes
[SUM]   2.00-3.00   sec  1.74 MBytes  14.6 Mbits/sec   31
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  28.5 MBytes   239 Mbits/sec   72    214 KBytes
[  7]   3.00-4.00   sec  17.1 MBytes   143 Mbits/sec  145    134 KBytes
[  9]   3.00-4.00   sec  38.8 MBytes   325 Mbits/sec  198    209 KBytes
[ 11]   3.00-4.00   sec  28.7 MBytes   241 Mbits/sec   76    187 KBytes
[ 13]   3.00-4.00   sec  22.6 MBytes   190 Mbits/sec  120    171 KBytes
[ 15]   3.00-4.00   sec  34.2 MBytes   287 Mbits/sec   33    260 KBytes
[ 17]   3.00-4.00   sec  30.9 MBytes   260 Mbits/sec  113    199 KBytes
[ 19]   3.00-4.00   sec  19.6 MBytes   164 Mbits/sec  121    112 KBytes
[ 21]   3.00-4.00   sec  18.0 MBytes   151 Mbits/sec  155    105 KBytes
[ 23]   3.00-4.00   sec  30.4 MBytes   256 Mbits/sec  121    185 KBytes
[SUM]   3.00-4.00   sec   269 MBytes  2.26 Gbits/sec  1154
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  48.9 MBytes   410 Mbits/sec    0    322 KBytes
[  7]   4.00-5.00   sec  37.7 MBytes   316 Mbits/sec   45    208 KBytes
[  9]   4.00-5.00   sec  42.5 MBytes   357 Mbits/sec   31    189 KBytes
[ 11]   4.00-5.00   sec  48.3 MBytes   406 Mbits/sec   20    238 KBytes
[ 13]   4.00-5.00   sec  39.7 MBytes   333 Mbits/sec   21    178 KBytes
[ 15]   4.00-5.00   sec  50.8 MBytes   426 Mbits/sec   35    245 KBytes
[ 17]   4.00-5.00   sec  43.2 MBytes   362 Mbits/sec   74    167 KBytes
[ 19]   4.00-5.00   sec  33.7 MBytes   283 Mbits/sec   27    158 KBytes
[ 21]   4.00-5.00   sec  34.6 MBytes   290 Mbits/sec   10    195 KBytes
[ 23]   4.00-5.00   sec  44.9 MBytes   377 Mbits/sec   76    188 KBytes
[SUM]   4.00-5.00   sec   424 MBytes  3.56 Gbits/sec  339
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   161 MBytes   271 Mbits/sec   81             sender
[  5]   0.00-5.01   sec   160 MBytes   267 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   144 MBytes   241 Mbits/sec  207             sender
[  7]   0.00-5.01   sec   142 MBytes   238 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   183 MBytes   307 Mbits/sec  322             sender
[  9]   0.00-5.01   sec   180 MBytes   302 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   168 MBytes   282 Mbits/sec  113             sender
[ 11]   0.00-5.01   sec   167 MBytes   280 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   153 MBytes   257 Mbits/sec  155             sender
[ 13]   0.00-5.01   sec   152 MBytes   254 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   176 MBytes   296 Mbits/sec  173             sender
[ 15]   0.00-5.01   sec   175 MBytes   294 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   166 MBytes   278 Mbits/sec  211             sender
[ 17]   0.00-5.01   sec   164 MBytes   275 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   145 MBytes   244 Mbits/sec  222             sender
[ 19]   0.00-5.01   sec   144 MBytes   241 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   144 MBytes   241 Mbits/sec  214             sender
[ 21]   0.00-5.01   sec   142 MBytes   238 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   158 MBytes   265 Mbits/sec  244             sender
[ 23]   0.00-5.01   sec   157 MBytes   263 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.56 GBytes  2.68 Gbits/sec  1942             sender
[SUM]   0.00-5.01   sec  1.54 GBytes  2.65 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up         53305   3538027          0      482751   728845922          0
eth1  up         64260   4273382          0      669608  1010997737          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.