Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=447 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 447.481/447.481/447.481/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 36042 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 36044 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 36054 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 36060 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 36068 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 36080 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 36096 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 36108 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 36118 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 36122 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  34.3 MBytes   288 Mbits/sec   76    181 KBytes
[  7]   0.00-1.00   sec  41.9 MBytes   352 Mbits/sec   16    313 KBytes
[  9]   0.00-1.00   sec  34.3 MBytes   288 Mbits/sec  100    219 KBytes
[ 11]   0.00-1.00   sec  36.2 MBytes   304 Mbits/sec  112    202 KBytes
[ 13]   0.00-1.00   sec  32.7 MBytes   274 Mbits/sec   65    188 KBytes
[ 15]   0.00-1.00   sec  35.7 MBytes   299 Mbits/sec   74    238 KBytes
[ 17]   0.00-1.00   sec  35.5 MBytes   298 Mbits/sec  117    192 KBytes
[ 19]   0.00-1.00   sec  35.1 MBytes   295 Mbits/sec  110    192 KBytes
[ 21]   0.00-1.00   sec  30.8 MBytes   258 Mbits/sec  142    178 KBytes
[ 23]   0.00-1.00   sec  29.8 MBytes   250 Mbits/sec  109    163 KBytes
[SUM]   0.00-1.00   sec   346 MBytes  2.91 Gbits/sec  921
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  33.7 MBytes   283 Mbits/sec   48    198 KBytes
[  7]   1.00-2.00   sec  34.8 MBytes   292 Mbits/sec  126    197 KBytes
[  9]   1.00-2.00   sec  32.2 MBytes   270 Mbits/sec   50    188 KBytes
[ 11]   1.00-2.00   sec  33.6 MBytes   281 Mbits/sec   74    204 KBytes
[ 13]   1.00-2.00   sec  32.7 MBytes   274 Mbits/sec   63    170 KBytes
[ 15]   1.00-2.00   sec  32.6 MBytes   273 Mbits/sec  117    189 KBytes
[ 17]   1.00-2.00   sec  31.1 MBytes   261 Mbits/sec   43    167 KBytes
[ 19]   1.00-2.00   sec  32.4 MBytes   272 Mbits/sec   17    238 KBytes
[ 21]   1.00-2.00   sec  32.3 MBytes   271 Mbits/sec   45    194 KBytes
[ 23]   1.00-2.00   sec  30.9 MBytes   259 Mbits/sec   45    226 KBytes
[SUM]   1.00-2.00   sec   326 MBytes  2.74 Gbits/sec  628
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  31.9 MBytes   267 Mbits/sec   45    250 KBytes
[  7]   2.00-3.00   sec  30.4 MBytes   255 Mbits/sec   46    192 KBytes
[  9]   2.00-3.00   sec  30.6 MBytes   257 Mbits/sec   28    191 KBytes
[ 11]   2.00-3.00   sec  34.8 MBytes   292 Mbits/sec    0    296 KBytes
[ 13]   2.00-3.00   sec  32.7 MBytes   275 Mbits/sec    0    273 KBytes
[ 15]   2.00-3.00   sec  30.8 MBytes   258 Mbits/sec   48    243 KBytes
[ 17]   2.00-3.00   sec  31.2 MBytes   262 Mbits/sec   35    211 KBytes
[ 19]   2.00-3.00   sec  31.6 MBytes   265 Mbits/sec   49    206 KBytes
[ 21]   2.00-3.00   sec  30.0 MBytes   252 Mbits/sec   15    194 KBytes
[ 23]   2.00-3.00   sec  32.2 MBytes   270 Mbits/sec   26    256 KBytes
[SUM]   2.00-3.00   sec   316 MBytes  2.65 Gbits/sec  292
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  39.0 MBytes   327 Mbits/sec   59    184 KBytes
[  7]   3.00-4.00   sec  34.2 MBytes   287 Mbits/sec   43    198 KBytes
[  9]   3.00-4.00   sec  32.3 MBytes   271 Mbits/sec   78   99.0 KBytes
[ 11]   3.00-4.00   sec  38.1 MBytes   320 Mbits/sec   94    212 KBytes
[ 13]   3.00-4.00   sec  35.8 MBytes   300 Mbits/sec   59    163 KBytes
[ 15]   3.00-4.00   sec  30.6 MBytes   256 Mbits/sec   41    134 KBytes
[ 17]   3.00-4.00   sec  29.8 MBytes   250 Mbits/sec   61    184 KBytes
[ 19]   3.00-4.00   sec  34.1 MBytes   286 Mbits/sec   66    188 KBytes
[ 21]   3.00-4.00   sec  33.2 MBytes   278 Mbits/sec    5    184 KBytes
[ 23]   3.00-4.00   sec  30.1 MBytes   253 Mbits/sec  119    140 KBytes
[SUM]   3.00-4.00   sec   337 MBytes  2.83 Gbits/sec  625
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  36.6 MBytes   307 Mbits/sec   58    151 KBytes
[  7]   4.00-5.00   sec  38.3 MBytes   321 Mbits/sec   33    189 KBytes
[  9]   4.00-5.00   sec  31.3 MBytes   262 Mbits/sec   30    158 KBytes
[ 11]   4.00-5.00   sec  41.3 MBytes   347 Mbits/sec   46    182 KBytes
[ 13]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec   62    165 KBytes
[ 15]   4.00-5.00   sec  35.5 MBytes   298 Mbits/sec   54    158 KBytes
[ 17]   4.00-5.00   sec  39.6 MBytes   332 Mbits/sec   52    177 KBytes
[ 19]   4.00-5.00   sec  41.1 MBytes   345 Mbits/sec    4    218 KBytes
[ 21]   4.00-5.00   sec  38.5 MBytes   323 Mbits/sec   22    255 KBytes
[ 23]   4.00-5.00   sec  36.9 MBytes   310 Mbits/sec   39    226 KBytes
[SUM]   4.00-5.00   sec   376 MBytes  3.16 Gbits/sec  400
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   175 MBytes   294 Mbits/sec  286             sender
[  5]   0.00-5.01   sec   174 MBytes   291 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   180 MBytes   301 Mbits/sec  264             sender
[  7]   0.00-5.01   sec   178 MBytes   298 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   161 MBytes   270 Mbits/sec  286             sender
[  9]   0.00-5.01   sec   159 MBytes   267 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   184 MBytes   309 Mbits/sec  326             sender
[ 11]   0.00-5.01   sec   182 MBytes   305 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   171 MBytes   287 Mbits/sec  249             sender
[ 13]   0.00-5.01   sec   170 MBytes   285 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   165 MBytes   277 Mbits/sec  334             sender
[ 15]   0.00-5.01   sec   164 MBytes   275 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   167 MBytes   280 Mbits/sec  308             sender
[ 17]   0.00-5.01   sec   166 MBytes   278 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   174 MBytes   292 Mbits/sec  246             sender
[ 19]   0.00-5.01   sec   173 MBytes   289 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   165 MBytes   276 Mbits/sec  229             sender
[ 21]   0.00-5.01   sec   163 MBytes   274 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   160 MBytes   268 Mbits/sec  338             sender
[ 23]   0.00-5.01   sec   159 MBytes   266 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.66 GBytes  2.86 Gbits/sec  2866             sender
[SUM]   0.00-5.01   sec  1.65 GBytes  2.83 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        272826  18032637          0     1226826  1857330943          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.304 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.1.140

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 47566 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 47580 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 47594 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 47600 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 47604 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 47620 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 47632 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 47640 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 47644 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 47650 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  30.4 MBytes   255 Mbits/sec   95   73.5 KBytes
[  7]   0.00-1.00   sec  45.4 MBytes   381 Mbits/sec  209    229 KBytes
[  9]   0.00-1.00   sec  46.5 MBytes   390 Mbits/sec  311    382 KBytes
[ 11]   0.00-1.00   sec  45.9 MBytes   385 Mbits/sec  124    229 KBytes
[ 13]   0.00-1.00   sec  24.9 MBytes   209 Mbits/sec  290   94.7 KBytes
[ 15]   0.00-1.00   sec  38.4 MBytes   322 Mbits/sec   66    198 KBytes
[ 17]   0.00-1.00   sec  25.8 MBytes   216 Mbits/sec   82   84.8 KBytes
[ 19]   0.00-1.00   sec  37.2 MBytes   312 Mbits/sec   47    182 KBytes
[ 21]   0.00-1.00   sec  33.7 MBytes   282 Mbits/sec  104    147 KBytes
[ 23]   0.00-1.00   sec  43.2 MBytes   363 Mbits/sec  143    214 KBytes
[SUM]   0.00-1.00   sec   371 MBytes  3.12 Gbits/sec  1471
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  18.7 MBytes   157 Mbits/sec   12    146 KBytes
[  7]   1.00-2.00   sec  34.7 MBytes   291 Mbits/sec  134    161 KBytes
[  9]   1.00-2.00   sec  47.7 MBytes   400 Mbits/sec   96    242 KBytes
[ 11]   1.00-2.00   sec  36.2 MBytes   304 Mbits/sec   61    160 KBytes
[ 13]   1.00-2.00   sec  52.0 MBytes   436 Mbits/sec  261    239 KBytes
[ 15]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec    4    252 KBytes
[ 17]   1.00-2.00   sec  43.1 MBytes   362 Mbits/sec  232    235 KBytes
[ 19]   1.00-2.00   sec  27.1 MBytes   227 Mbits/sec   50    137 KBytes
[ 21]   1.00-2.00   sec  28.0 MBytes   235 Mbits/sec   63    153 KBytes
[ 23]   1.00-2.00   sec  39.9 MBytes   335 Mbits/sec   21    197 KBytes
[SUM]   1.00-2.00   sec   363 MBytes  3.04 Gbits/sec  934
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  42.2 MBytes   354 Mbits/sec   23    116 KBytes
[  7]   2.00-3.00   sec  51.6 MBytes   433 Mbits/sec   48    218 KBytes
[  9]   2.00-3.00   sec  39.8 MBytes   334 Mbits/sec   41    129 KBytes
[ 11]   2.00-3.00   sec  34.1 MBytes   286 Mbits/sec   55    116 KBytes
[ 13]   2.00-3.00   sec  58.3 MBytes   489 Mbits/sec   23    195 KBytes
[ 15]   2.00-3.00   sec  48.1 MBytes   403 Mbits/sec   36    170 KBytes
[ 17]   2.00-3.00   sec  49.5 MBytes   415 Mbits/sec   16    225 KBytes
[ 19]   2.00-3.00   sec  34.8 MBytes   292 Mbits/sec   51    140 KBytes
[ 21]   2.00-3.00   sec  28.9 MBytes   242 Mbits/sec   25    157 KBytes
[ 23]   2.00-3.00   sec  49.5 MBytes   415 Mbits/sec   13    260 KBytes
[SUM]   2.00-3.00   sec   437 MBytes  3.66 Gbits/sec  331
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  30.4 MBytes   255 Mbits/sec   74    115 KBytes
[  7]   3.00-4.00   sec  49.4 MBytes   415 Mbits/sec   63    208 KBytes
[  9]   3.00-4.00   sec  28.6 MBytes   240 Mbits/sec   23    139 KBytes
[ 11]   3.00-4.00   sec  33.1 MBytes   277 Mbits/sec   49    163 KBytes
[ 13]   3.00-4.00   sec  51.6 MBytes   433 Mbits/sec  107    178 KBytes
[ 15]   3.00-4.00   sec  36.1 MBytes   303 Mbits/sec   68    136 KBytes
[ 17]   3.00-4.00   sec  45.4 MBytes   381 Mbits/sec  127    161 KBytes
[ 19]   3.00-4.00   sec  44.0 MBytes   369 Mbits/sec   16    209 KBytes
[ 21]   3.00-4.00   sec  29.7 MBytes   249 Mbits/sec   73    113 KBytes
[ 23]   3.00-4.00   sec  56.4 MBytes   473 Mbits/sec   18    315 KBytes
[SUM]   3.00-4.00   sec   405 MBytes  3.39 Gbits/sec  618
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  31.8 MBytes   267 Mbits/sec    0    249 KBytes
[  7]   4.00-5.00   sec  42.9 MBytes   360 Mbits/sec  116    208 KBytes
[  9]   4.00-5.00   sec  30.0 MBytes   251 Mbits/sec   33    150 KBytes
[ 11]   4.00-5.00   sec  37.1 MBytes   311 Mbits/sec   83    187 KBytes
[ 13]   4.00-5.00   sec  39.2 MBytes   329 Mbits/sec   50    189 KBytes
[ 15]   4.00-5.00   sec  26.2 MBytes   219 Mbits/sec   19    116 KBytes
[ 17]   4.00-5.00   sec  34.5 MBytes   289 Mbits/sec   10    216 KBytes
[ 19]   4.00-5.00   sec  39.7 MBytes   333 Mbits/sec   10    171 KBytes
[ 21]   4.00-5.00   sec  31.1 MBytes   261 Mbits/sec    7    171 KBytes
[ 23]   4.00-5.00   sec  54.0 MBytes   453 Mbits/sec  182    180 KBytes
[SUM]   4.00-5.00   sec   367 MBytes  3.07 Gbits/sec  510
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   154 MBytes   258 Mbits/sec  204             sender
[  5]   0.00-5.07   sec   152 MBytes   251 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   224 MBytes   376 Mbits/sec  570             sender
[  7]   0.00-5.07   sec   222 MBytes   367 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   192 MBytes   323 Mbits/sec  504             sender
[  9]   0.00-5.07   sec   191 MBytes   316 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   186 MBytes   313 Mbits/sec  372             sender
[ 11]   0.00-5.07   sec   184 MBytes   304 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   226 MBytes   379 Mbits/sec  731             sender
[ 13]   0.00-5.07   sec   223 MBytes   370 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   184 MBytes   308 Mbits/sec  193             sender
[ 15]   0.00-5.07   sec   182 MBytes   302 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   198 MBytes   333 Mbits/sec  467             sender
[ 17]   0.00-5.07   sec   196 MBytes   325 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   183 MBytes   307 Mbits/sec  174             sender
[ 19]   0.00-5.07   sec   181 MBytes   299 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   151 MBytes   254 Mbits/sec  272             sender
[ 21]   0.00-5.07   sec   149 MBytes   247 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   243 MBytes   408 Mbits/sec  377             sender
[ 23]   0.00-5.07   sec   240 MBytes   398 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.90 GBytes  3.26 Gbits/sec  3864             sender
[SUM]   0.00-5.07   sec  1.87 GBytes  3.18 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        164102  10849633          0      763377  1155503048          0
eth1  up        151850  10048717          0      632099   956689706          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.