Hash-Policy

These scenarios cover some aspects related to link-aggregation. This particular one covers the hash-policy configuration needed to setup the desired load balancing. In OSDx, this can be achieved using bonding interfaces in either xor-hash or 802.3ad modes, or transmit-load-balance and adaptive-load-balance in static mode.

../../../../_images/topology1.svg

Test hash-policy

Description

A bonding interface is configured in DUT0 using xor-hash mode. This scenario shows how to set the hash-policy option to manage load balancing.

Scenario

Step 1: Set the following configuration in DUT0 :

set interfaces bonding bond0 address 192.168.100.10/24
set interfaces bonding bond0 miimon 100
set interfaces bonding bond0 mode xor-hash
set interfaces ethernet eth0 bond-group bond0
set interfaces ethernet eth1 bond-group bond0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 2: Set the following configuration in DUT1 :

set interfaces bridge br0 address 192.168.100.20/24
set interfaces bridge br0 stp version rstp
set interfaces ethernet eth0 bridge-group bridge br0
set interfaces ethernet eth1 bridge-group bridge br0
set system login user admin authentication encrypted-password '$6$GSjsCj8gHLv$/VcqU6FLi6CT2Oxn0MJQ2C2tqnRDrYKNF8HIYWJp68nvXvPdFccDsT04.WtigUONbKYrgKg8d6rEs8PjljMkH0'

Step 3: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 4: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 5: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=437 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 436.907/436.907/436.907/0.000 ms

Step 6: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer2 (0)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 7: Run command interfaces ethernet clear at DUT0.

Step 8: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 54170 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 54180 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 54182 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 54198 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 54214 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 54228 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 54236 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 54240 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 54254 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 54256 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  32.4 MBytes   271 Mbits/sec  140    219 KBytes
[  7]   0.00-1.00   sec  31.5 MBytes   264 Mbits/sec   35    284 KBytes
[  9]   0.00-1.00   sec  30.8 MBytes   258 Mbits/sec   77    178 KBytes
[ 11]   0.00-1.00   sec  29.9 MBytes   251 Mbits/sec  102    126 KBytes
[ 13]   0.00-1.00   sec  29.7 MBytes   249 Mbits/sec  101    136 KBytes
[ 15]   0.00-1.00   sec  30.0 MBytes   252 Mbits/sec  119    133 KBytes
[ 17]   0.00-1.00   sec  30.8 MBytes   258 Mbits/sec   62    185 KBytes
[ 19]   0.00-1.00   sec  29.7 MBytes   249 Mbits/sec   54    174 KBytes
[ 21]   0.00-1.00   sec  30.7 MBytes   258 Mbits/sec  127    250 KBytes
[ 23]   0.00-1.00   sec  29.8 MBytes   250 Mbits/sec   99    178 KBytes
[SUM]   0.00-1.00   sec   305 MBytes  2.56 Gbits/sec  916
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  24.1 MBytes   202 Mbits/sec   67    181 KBytes
[  7]   1.00-2.00   sec  25.7 MBytes   216 Mbits/sec  103    199 KBytes
[  9]   1.00-2.00   sec  25.4 MBytes   213 Mbits/sec   46    197 KBytes
[ 11]   1.00-2.00   sec  23.4 MBytes   197 Mbits/sec    5    171 KBytes
[ 13]   1.00-2.00   sec  23.6 MBytes   198 Mbits/sec   30    126 KBytes
[ 15]   1.00-2.00   sec  23.1 MBytes   193 Mbits/sec   45    174 KBytes
[ 17]   1.00-2.00   sec  23.7 MBytes   199 Mbits/sec   42    194 KBytes
[ 19]   1.00-2.00   sec  24.2 MBytes   203 Mbits/sec   47    188 KBytes
[ 21]   1.00-2.00   sec  24.4 MBytes   204 Mbits/sec    8    249 KBytes
[ 23]   1.00-2.00   sec  22.1 MBytes   185 Mbits/sec   90    165 KBytes
[SUM]   1.00-2.00   sec   240 MBytes  2.01 Gbits/sec  483
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  30.9 MBytes   260 Mbits/sec   21    238 KBytes
[  7]   2.00-3.00   sec  29.0 MBytes   243 Mbits/sec   41    204 KBytes
[  9]   2.00-3.00   sec  29.2 MBytes   245 Mbits/sec   63    206 KBytes
[ 11]   2.00-3.00   sec  28.5 MBytes   239 Mbits/sec   71    174 KBytes
[ 13]   2.00-3.00   sec  29.3 MBytes   246 Mbits/sec    5    219 KBytes
[ 15]   2.00-3.00   sec  30.4 MBytes   255 Mbits/sec    0    253 KBytes
[ 17]   2.00-3.00   sec  30.2 MBytes   253 Mbits/sec   31    202 KBytes
[ 19]   2.00-3.00   sec  29.0 MBytes   243 Mbits/sec   23    219 KBytes
[ 21]   2.00-3.00   sec  29.0 MBytes   243 Mbits/sec   42    168 KBytes
[ 23]   2.00-3.00   sec  28.5 MBytes   239 Mbits/sec   58    168 KBytes
[SUM]   2.00-3.00   sec   294 MBytes  2.47 Gbits/sec  355
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  33.3 MBytes   279 Mbits/sec   29    230 KBytes
[  7]   3.00-4.00   sec  33.3 MBytes   279 Mbits/sec   69    184 KBytes
[  9]   3.00-4.00   sec  34.0 MBytes   285 Mbits/sec    5    181 KBytes
[ 11]   3.00-4.00   sec  33.8 MBytes   283 Mbits/sec    8    243 KBytes
[ 13]   3.00-4.00   sec  34.2 MBytes   287 Mbits/sec   65    185 KBytes
[ 15]   3.00-4.00   sec  35.5 MBytes   297 Mbits/sec   55    256 KBytes
[ 17]   3.00-4.00   sec  33.3 MBytes   279 Mbits/sec   54    180 KBytes
[ 19]   3.00-4.00   sec  32.8 MBytes   275 Mbits/sec   50    204 KBytes
[ 21]   3.00-4.00   sec  30.5 MBytes   256 Mbits/sec   39    191 KBytes
[ 23]   3.00-4.00   sec  29.8 MBytes   250 Mbits/sec  106    140 KBytes
[SUM]   3.00-4.00   sec   330 MBytes  2.77 Gbits/sec  480
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  37.1 MBytes   311 Mbits/sec   45    266 KBytes
[  7]   4.00-5.00   sec  36.6 MBytes   307 Mbits/sec   19    233 KBytes
[  9]   4.00-5.00   sec  33.8 MBytes   284 Mbits/sec    9    215 KBytes
[ 11]   4.00-5.00   sec  35.0 MBytes   294 Mbits/sec   46    235 KBytes
[ 13]   4.00-5.00   sec  34.2 MBytes   287 Mbits/sec   27    215 KBytes
[ 15]   4.00-5.00   sec  36.6 MBytes   307 Mbits/sec    1    269 KBytes
[ 17]   4.00-5.00   sec  37.2 MBytes   312 Mbits/sec    0    274 KBytes
[ 19]   4.00-5.00   sec  36.5 MBytes   306 Mbits/sec    1    266 KBytes
[ 21]   4.00-5.00   sec  37.4 MBytes   314 Mbits/sec    0    279 KBytes
[ 23]   4.00-5.00   sec  33.9 MBytes   285 Mbits/sec   12    236 KBytes
[SUM]   4.00-5.00   sec   358 MBytes  3.01 Gbits/sec  160
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   158 MBytes   265 Mbits/sec  302             sender
[  5]   0.00-5.01   sec   156 MBytes   261 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   156 MBytes   262 Mbits/sec  267             sender
[  7]   0.00-5.01   sec   154 MBytes   258 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   153 MBytes   257 Mbits/sec  200             sender
[  9]   0.00-5.01   sec   152 MBytes   255 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   151 MBytes   253 Mbits/sec  232             sender
[ 11]   0.00-5.01   sec   149 MBytes   250 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   151 MBytes   253 Mbits/sec  228             sender
[ 13]   0.00-5.01   sec   149 MBytes   250 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   156 MBytes   261 Mbits/sec  220             sender
[ 15]   0.00-5.01   sec   154 MBytes   258 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   155 MBytes   260 Mbits/sec  189             sender
[ 17]   0.00-5.01   sec   154 MBytes   257 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   152 MBytes   255 Mbits/sec  175             sender
[ 19]   0.00-5.01   sec   151 MBytes   253 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   152 MBytes   255 Mbits/sec  216             sender
[ 21]   0.00-5.01   sec   150 MBytes   252 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   144 MBytes   242 Mbits/sec  365             sender
[ 23]   0.00-5.01   sec   142 MBytes   239 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.49 GBytes  2.56 Gbits/sec  2394             sender
[SUM]   0.00-5.01   sec  1.48 GBytes  2.53 Gbits/sec                  receiver

iperf Done.

Step 9: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

\s+up\s+(?:[1-9]?\d)\s+\d+\s+\d+\s+(?:[1-9]?\d)
\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up        138391   9157177          0     1098979  1663786507          0
eth1  up             0         0          0           0           0          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, traffic is going out through only one of the bonded interfaces.

Step 10: Modify the following configuration lines in DUT0 :

set interfaces bonding bond0 hash-policy layer3+4

Step 11: Run command interfaces bonding show at DUT0 and check if output matches the following regular expressions:

bond0\s+192.168.100\.10\/24\s+up\s+up
Show output
------------------------------------------------------------------
Name            IP Address           Admin  Oper  Vrf  Description
------------------------------------------------------------------
bond0  192.168.100.10/24             up     up
       fe80::dcad:beff:feef:6c01/64

Step 12: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Bonding Mode: load balancing (xor)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 13: Ping IP address 192.168.100.20 from DUT0:

admin@DUT0$ ping 192.168.100.20 count 1 size 56 timeout 1
Show output
PING 192.168.100.20 (192.168.100.20) 56(84) bytes of data.
64 bytes from 192.168.100.20: icmp_seq=1 ttl=64 time=0.454 ms

--- 192.168.100.20 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.454/0.454/0.454/0.000 ms

Step 14: Run command interfaces bonding bond0 show ports at DUT0 and check if output contains the following tokens:

Transmit Hash Policy: layer3+4 (1)
Show output
Ethernet Channel Bonding Driver: v6.12.73

Bonding Mode: load balancing (xor)
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eth1
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:01
Slave queue ID: 0

Slave Interface: eth0
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: de:ad:be:ef:6c:00
Slave queue ID: 0

Step 15: Run command interfaces ethernet clear at DUT0.

Step 16: Initiate a bandwidth test from DUT0 to DUT1

admin@DUT1$ monitor test performance server port 5001
admin@DUT0$ monitor test performance client 192.168.100.20 duration 5 port 5001 parallel 10
Expect this output in DUT0:
Connecting to host 192.168.100.20, port 5001
[  5] local 192.168.100.10 port 54274 connected to 192.168.100.20 port 5001
[  7] local 192.168.100.10 port 54280 connected to 192.168.100.20 port 5001
[  9] local 192.168.100.10 port 54288 connected to 192.168.100.20 port 5001
[ 11] local 192.168.100.10 port 54302 connected to 192.168.100.20 port 5001
[ 13] local 192.168.100.10 port 54318 connected to 192.168.100.20 port 5001
[ 15] local 192.168.100.10 port 54334 connected to 192.168.100.20 port 5001
[ 17] local 192.168.100.10 port 54344 connected to 192.168.100.20 port 5001
[ 19] local 192.168.100.10 port 54354 connected to 192.168.100.20 port 5001
[ 21] local 192.168.100.10 port 54356 connected to 192.168.100.20 port 5001
[ 23] local 192.168.100.10 port 54370 connected to 192.168.100.20 port 5001
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  32.5 MBytes   273 Mbits/sec   57    305 KBytes
[  7]   0.00-1.00   sec  38.1 MBytes   320 Mbits/sec   85    359 KBytes
[  9]   0.00-1.00   sec  47.6 MBytes   399 Mbits/sec  147    362 KBytes
[ 11]   0.00-1.00   sec  22.1 MBytes   186 Mbits/sec   88    167 KBytes
[ 13]   0.00-1.00   sec  37.9 MBytes   318 Mbits/sec  101    276 KBytes
[ 15]   0.00-1.00   sec  33.6 MBytes   282 Mbits/sec   84    362 KBytes
[ 17]   0.00-1.00   sec  38.7 MBytes   324 Mbits/sec   80    269 KBytes
[ 19]   0.00-1.00   sec  23.7 MBytes   199 Mbits/sec   55    181 KBytes
[ 21]   0.00-1.00   sec  39.8 MBytes   334 Mbits/sec  143    277 KBytes
[ 23]   0.00-1.00   sec  28.6 MBytes   240 Mbits/sec  157    214 KBytes
[SUM]   0.00-1.00   sec   343 MBytes  2.88 Gbits/sec  997
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  29.8 MBytes   249 Mbits/sec   78    164 KBytes
[  7]   1.00-2.00   sec  40.6 MBytes   340 Mbits/sec  181    243 KBytes
[  9]   1.00-2.00   sec  46.2 MBytes   387 Mbits/sec  105    209 KBytes
[ 11]   1.00-2.00   sec  24.7 MBytes   207 Mbits/sec   81    150 KBytes
[ 13]   1.00-2.00   sec  27.5 MBytes   230 Mbits/sec   77    206 KBytes
[ 15]   1.00-2.00   sec  35.1 MBytes   294 Mbits/sec  132    205 KBytes
[ 17]   1.00-2.00   sec  34.3 MBytes   287 Mbits/sec   67    206 KBytes
[ 19]   1.00-2.00   sec  21.1 MBytes   177 Mbits/sec   48    122 KBytes
[ 21]   1.00-2.00   sec  38.2 MBytes   319 Mbits/sec   84    253 KBytes
[ 23]   1.00-2.00   sec  27.0 MBytes   226 Mbits/sec   50    215 KBytes
[SUM]   1.00-2.00   sec   325 MBytes  2.71 Gbits/sec  903
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  31.0 MBytes   261 Mbits/sec   51    168 KBytes
[  7]   2.00-3.00   sec  48.0 MBytes   404 Mbits/sec   41    218 KBytes
[  9]   2.00-3.00   sec  40.0 MBytes   337 Mbits/sec   98    158 KBytes
[ 11]   2.00-3.00   sec  28.2 MBytes   237 Mbits/sec   40    165 KBytes
[ 13]   2.00-3.00   sec  38.8 MBytes   326 Mbits/sec   50    214 KBytes
[ 15]   2.00-3.00   sec  31.9 MBytes   268 Mbits/sec   34    178 KBytes
[ 17]   2.00-3.00   sec  37.2 MBytes   313 Mbits/sec   63    154 KBytes
[ 19]   2.00-3.00   sec  21.4 MBytes   180 Mbits/sec   53    103 KBytes
[ 21]   2.00-3.00   sec  47.7 MBytes   401 Mbits/sec   52    223 KBytes
[ 23]   2.00-3.00   sec  38.7 MBytes   325 Mbits/sec   63    147 KBytes
[SUM]   2.00-3.00   sec   363 MBytes  3.05 Gbits/sec  545
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  32.9 MBytes   276 Mbits/sec    0    267 KBytes
[  7]   3.00-4.00   sec  46.0 MBytes   386 Mbits/sec    0    328 KBytes
[  9]   3.00-4.00   sec  38.8 MBytes   325 Mbits/sec    0    281 KBytes
[ 11]   3.00-4.00   sec  32.4 MBytes   272 Mbits/sec    0    263 KBytes
[ 13]   3.00-4.00   sec  33.8 MBytes   283 Mbits/sec    0    296 KBytes
[ 15]   3.00-4.00   sec  32.0 MBytes   268 Mbits/sec    7    212 KBytes
[ 17]   3.00-4.00   sec  37.6 MBytes   315 Mbits/sec    0    274 KBytes
[ 19]   3.00-4.00   sec  26.7 MBytes   224 Mbits/sec    0    223 KBytes
[ 21]   3.00-4.00   sec  43.1 MBytes   362 Mbits/sec    0    322 KBytes
[ 23]   3.00-4.00   sec  26.7 MBytes   224 Mbits/sec   30    192 KBytes
[SUM]   3.00-4.00   sec   350 MBytes  2.93 Gbits/sec   37
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  56.3 MBytes   472 Mbits/sec   55    264 KBytes
[  7]   4.00-5.00   sec  33.2 MBytes   279 Mbits/sec  178    221 KBytes
[  9]   4.00-5.00   sec  28.8 MBytes   241 Mbits/sec   25   21.2 KBytes
[ 11]   4.00-5.00   sec  56.1 MBytes   470 Mbits/sec   73    239 KBytes
[ 13]   4.00-5.00   sec  31.2 MBytes   262 Mbits/sec   67    209 KBytes
[ 15]   4.00-5.00   sec  30.0 MBytes   252 Mbits/sec   64    431 KBytes
[ 17]   4.00-5.00   sec  28.5 MBytes   239 Mbits/sec  128   18.4 KBytes
[ 19]   4.00-5.00   sec  53.9 MBytes   452 Mbits/sec   49    267 KBytes
[ 21]   4.00-5.00   sec  28.5 MBytes   239 Mbits/sec   90   18.4 KBytes
[ 23]   4.00-5.00   sec  53.5 MBytes   449 Mbits/sec   51    255 KBytes
[SUM]   4.00-5.00   sec   400 MBytes  3.36 Gbits/sec  780
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.00   sec   183 MBytes   306 Mbits/sec  241             sender
[  5]   0.00-5.01   sec   181 MBytes   303 Mbits/sec                  receiver
[  7]   0.00-5.00   sec   206 MBytes   346 Mbits/sec  485             sender
[  7]   0.00-5.01   sec   204 MBytes   341 Mbits/sec                  receiver
[  9]   0.00-5.00   sec   201 MBytes   338 Mbits/sec  375             sender
[  9]   0.00-5.01   sec   199 MBytes   333 Mbits/sec                  receiver
[ 11]   0.00-5.00   sec   164 MBytes   274 Mbits/sec  282             sender
[ 11]   0.00-5.01   sec   163 MBytes   272 Mbits/sec                  receiver
[ 13]   0.00-5.00   sec   169 MBytes   284 Mbits/sec  295             sender
[ 13]   0.00-5.01   sec   165 MBytes   277 Mbits/sec                  receiver
[ 15]   0.00-5.00   sec   163 MBytes   273 Mbits/sec  321             sender
[ 15]   0.00-5.01   sec   161 MBytes   269 Mbits/sec                  receiver
[ 17]   0.00-5.00   sec   176 MBytes   296 Mbits/sec  338             sender
[ 17]   0.00-5.01   sec   174 MBytes   292 Mbits/sec                  receiver
[ 19]   0.00-5.00   sec   147 MBytes   246 Mbits/sec  205             sender
[ 19]   0.00-5.01   sec   146 MBytes   244 Mbits/sec                  receiver
[ 21]   0.00-5.00   sec   197 MBytes   331 Mbits/sec  369             sender
[ 21]   0.00-5.01   sec   195 MBytes   326 Mbits/sec                  receiver
[ 23]   0.00-5.00   sec   174 MBytes   293 Mbits/sec  351             sender
[ 23]   0.00-5.01   sec   173 MBytes   290 Mbits/sec                  receiver
[SUM]   0.00-5.00   sec  1.74 GBytes  2.99 Gbits/sec  3262             sender
[SUM]   0.00-5.01   sec  1.72 GBytes  2.95 Gbits/sec                  receiver

iperf Done.

Step 17: Run command interfaces ethernet show counters at DUT0 and check if output matches the following regular expressions:

eth0\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
eth1\s+up\s+\d{4,}\s+\d+\s+\d+\s+\d{4,}
Show output
------------------------------------------------------------------------------
Name  Oper  Rx Packets  Rx Bytes  Rx Errors  Tx Packets   Tx Bytes   Tx Errors
------------------------------------------------------------------------------
eth0  up         78517   5203684          0      719580  1088920310          0
eth1  up         77820   5153769          0      560373   848269055          0
eth2  down           0         0          0           0           0          0
eth3  down           0         0          0           0           0          0

Note

As you can see, this time traffic is going out through both bonded interfaces.